00000001:02000400:2.0F:1788581846.431126:0:2963:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg112-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1788581864.562026:0:3183:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg112-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1788581866.663262:0:3243:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 455 MB/s 00000001:01000000:3.0F:1788581866.917667:0:3243:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 567 MB/s 00000001:01000000:0.0F:1788581867.167306:0:3243:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 2803 MB/s 00000020:02000000:1.0:1788581867.851921:0:3275:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_104_g4a8f637 00000400:02000000:3.0:1788581868.929652:0:3290:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.201.112@tcp [8/256/0/180] 00008000:02000000:2.0:1788581872.442453:0:3439:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1788581916.832332:0:5243:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg112-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788581925.587734:0:5824:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788581925.587740:0:5824:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788581925.587874:0:5824:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000f5f2db8d 00000080:02000400:2.0:1788581925.587894:0:5824:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1788581925.592801:0:5824:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1788581925.592817:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788581925.592859:0:5824:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000004c355a11) 00000020:00000080:2.0:1788581925.592977:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788581925.604097:0:5824:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1788581925.604493:0:5824:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788581925.621790:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788581925.621824:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788581925.621844:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788581925.621922:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788581925.621953:0:5824:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788581925.622299:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788581925.622306:0:5824:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788581925.622316:0:5824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bc3aa892c3a6874 00000020:01000004:2.0:1788581925.622323:0:5824:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788581925.622328:0:5824:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788581925.622332:0:5824:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f5f2db8d from MGS 00000020:01000004:2.0:1788581925.622336:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788581925.622345:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000001dc38d56) 00000020:00000080:2.0:1788581925.622354:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788581925.622422:0:5824:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f5f2db8d from MGS, refs=2 00080000:01000000:2.0:1788581925.622427:0:5824:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788581925.622432:0:5824:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bc3aa892c3a6882 00000100:00100000:2.0:1788581925.622588:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788581925.622712:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788581925.622723:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788581925.623173:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788581925.623180:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788581925.624356:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788581925.624568:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788581925.624572:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788581925.626010:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788581925.626017:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788581925.626591:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788581925.626605:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:1.0:1788581925.627228:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581925.627232:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581925.627234:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581925.627640:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581925.627643:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581925.627645:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581925.628106:0:5824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788581925.630427:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788581925.877326:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 4063 MB/s 00000001:01000000:1.0:1788581926.127295:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3639 MB/s 00000001:01000000:3.0:1788581926.378938:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 498 MB/s 00000001:01000000:2.0:1788581926.629766:0:5824:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 796 MB/s 00010000:00010000:1.0:1788581926.637354:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:3.0:1788581926.655307:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:2.0:1788581926.682754:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1788581926.682783:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788581926.682786:0:5824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788581926.688869:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1788581926.688950:0:5824:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1788581926.689016:0:5824:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1788581926.689351:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788581926.689381:0:5824:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1788581926.689687:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788581926.689846:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1788581926.689852:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788581926.694736:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788581926.694749:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788581926.695309:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788581926.695316:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788581926.695888:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788581926.695908:0:5824:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.112@tcp' 00000020:01000004:2.0:1788581926.695910:0:5824:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788581926.696079:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.112@tcp (typ=mgc) 00000020:00000080:2.0:1788581926.696092:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.112@tcp (0000000013c3a7dd) 00000020:00000080:2.0:1788581926.696109:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788581926.696186:0:5824:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000012d2ebc3@MGC192.168.201.112@tcp: add connection 192.168.201.112@tcp at head 00010000:00010000:2.0:1788581926.696382:0:5824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.112@tcp-0 is initialized 00000040:01000000:2.0:1788581926.696388:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.112@tcp ctxt 1 is initialized 00000100:00080000:3.0:1788581926.696518:0:5839:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1788581926.709807:0:5840:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788581926.710249:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.112@tcp (uuid 440dcdbb-2cf9-4bb9-89ca-da9aec3e214b) 00000020:00000080:3.0:1788581926.710272:0:5824:0:(genops.c:1385:class_connect()) connect: client 440dcdbb-2cf9-4bb9-89ca-da9aec3e214b, cookie 0x2bc3aa892c3a6890 00000100:00080000:3.0:1788581926.710284:0:5824:0:(import.c:510:import_select_connection()) MGC192.168.201.112@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788581926.710289:0:5824:0:(import.c:624:import_select_connection()) MGC192.168.201.112@tcp: import 0000000012d2ebc3 using connection 192.168.201.112@tcp/0@lo 00000100:00100000:3.0:1788581926.710330:0:5824:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000060371704 x1875464020820096/t0(0) o250->MGC192.168.201.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788581926.710353:0:5824:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 440dcdbb-2cf9-4bb9-89ca-da9aec3e214b->MGS 00000020:01000004:3.0:1788581926.710369:0:5824:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788581926.710373:0:5824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788581926.710393:0:5824:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000002194a86d) 00000020:00000080:3.0:1788581926.710406:0:5824:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788581926.718057:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000060371704 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3305:1875464020820096:0@lo:250: 00000100:00100000:2.0:1788581926.718134:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581926.718220:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020820096 00000100:00100000:2.0:1788581926.718231:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020820096 00000100:00100000:2.0:1788581926.718264:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788581926.718270:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002e4054da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1875464020820096:12345-0@lo:250: 00010000:00080000:2.0:1788581926.718293:0:5836:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 440dcdbb-2cf9-4bb9-89ca-da9aec3e214b@0@lo t0 exp 0000000000000000 cur 145 last 0 00000020:00000080:2.0:1788581926.718319:0:5836:0:(genops.c:1385:class_connect()) connect: client 440dcdbb-2cf9-4bb9-89ca-da9aec3e214b, cookie 0x2bc3aa892c3a689e 00000100:00080000:2.0:1788581926.718446:0:5836:0:(import.c:65:import_set_state_nolock()) 000000005e21ceab : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581926.718493:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002e4054da pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+5:3305:x1875464020820096:12345-0@lo:250: Request processed in 221us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581926.718500:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788581926.718537:0:3305:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.112@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788581926.718544:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.112@tcp: connect to target with instance 0 00000100:00080000:2.0:1788581926.718551:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.112@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788581926.718555:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788581926.718557:0:3305:0:(import.c:65:import_set_state_nolock()) 0000000012d2ebc3 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788581926.718560:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788581926.718567:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788581926.718571:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000060371704 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3305:1875464020820096:0@lo:250: 00000100:00100000:3.0:1788581926.724609:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788581926.724804:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788581926.724811:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788581926.727423:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788581926.727440:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788581926.727949:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788581926.727955:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788581926.729012:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788581926.729188:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788581926.729194:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788581926.729841:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788581926.729848:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788581926.759997:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788581926.760376:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788581926.760381:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788581926.762512:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788581926.762566:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788581926.763504:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788581926.763816:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788581926.763821:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788581926.764839:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788581926.764853:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788581926.765398:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788581926.765548:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788581926.765553:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788581926.765944:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788581926.765950:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788581926.766464:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788581926.766726:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788581926.766732:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788581926.767081:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788581926.767088:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788581926.786905:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788581926.787153:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788581926.787158:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788581926.790302:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788581926.790319:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788581926.792123:0:5824:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788581926.792149:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788581926.793046:0:5824:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788581926.793070:0:5824:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788581926.793077:0:5824:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.112@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788581926.793361:0:5824:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.112@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788581926.793403:0:5824:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.112@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788581926.793409:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788581926.793410:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788581926.793412:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581926.793413:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581926.793414:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581926.793416:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581926.793417:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788581926.793419:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788581926.793420:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788581926.793422:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788581926.793423:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581926.793425:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788581926.793428:0:5824:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788581926.793430:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788581926.793432:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788581926.793432:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581926.793433:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788581926.793434:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581926.793436:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581926.793437:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788581926.793438:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788581926.793439:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788581926.793440:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788581926.793441:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581926.793442:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788581926.793480:0:5824:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788581926.793497:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058b11025 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020820224:0@lo:253: 00000100:00100000:2.0:1788581926.793730:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581926.793837:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000003ae328f0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581926.793896:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020820224 00000100:00100000:3.0:1788581926.793907:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020820224 00000100:00100000:3.0:1788581926.793985:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788581926.793994:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0510025 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+5:5824:x1875464020820224:12345-0@lo:253: 20000000:01000000:3.0:1788581926.794053:0:5838:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788581926.794056:0:5838:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1788581926.794429:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788581926.794496:0:5838:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788581926.794957:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581926.796135:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1788581926.796497:0:5838:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788581926.796501:0:5838:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1788581926.796506:0:5838:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1788581926.796509:0:5838:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1788581926.796525:0:5838:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1788581926.796807:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788581926.797033:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1788581926.797045:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1788581926.797092:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1788581926.797138:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1788581926.797173:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1788581926.797536:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1788581926.797545:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1788581926.797694:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1788581926.797709:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1788581926.797745:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1788581926.797753:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1788581926.797784:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1788581926.797843:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1788581926.797891:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1788581926.797896:0:5838:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1788581926.797910:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788581926.798122:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1788581926.798131:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1788581926.798164:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1788581926.798372:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1788581926.798427:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1788581926.798438:0:5838:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1788581926.798503:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1788581926.798510:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788581926.798551:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1788581926.798658:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1788581926.798698:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1788581926.798710:0:5838:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1788581926.798796:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1788581926.798805:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1788581926.798832:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1788581926.798872:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1788581926.799002:0:5838:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1788581926.799039:0:5838:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1788581926.799046:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1788581926.799516:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1788581926.799872:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1788581926.799895:0:5838:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.112@tcp for mdt 20000000:01000000:3.0:1788581926.799898:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.112@tcp (null) (null) (null) 00000040:00080000:3.0:1788581926.799945:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1788581926.799952:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1788581926.799990:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1788581926.799998:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.112@tcp (null) (null) 00000040:00080000:3.0:1788581926.800055:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1788581926.800066:0:5838:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1788581926.800099:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1788581926.800135:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1788581926.800193:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1788581926.800196:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1788581926.804744:0:5838:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1788581926.804774:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788581926.804777:0:5838:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788581926.804831:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788581926.804833:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788581926.805667:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1788581926.806034:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1788581926.806084:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1788581926.806187:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1788581926.806243:0:5838:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788581926.806246:0:5838:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788581926.806803:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1788581926.807031:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1788581926.807067:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1788581926.807097:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1788581926.807109:0:5838:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788581926.807112:0:5838:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1788581926.807117:0:5838:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788581926.807119:0:5838:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1788581926.807124:0:5838:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1788581926.807129:0:5838:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1788581926.807488:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:2.0:1788581926.809948:0:5838:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:2.0:1788581926.817164:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:2.0:1788581926.817422:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:2.0:1788581926.819890:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:2.0:1788581926.819928:0:5838:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788581926.819949:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000088d63091/0x2bc3aa892c3a68a5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581926.819964:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000088d63091/0x2bc3aa892c3a68a5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581926.819971:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000088d63091/0x2bc3aa892c3a68a5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581926.819975:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000088d63091/0x2bc3aa892c3a68a5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581926.819979:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000088d63091/0x2bc3aa892c3a68a5 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581926.819983:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000088d63091/0x2bc3aa892c3a68a5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581926.819986:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000088d63091 already unused, calling callback (00000000732149c4) 00010000:00010000:2.0:1788581926.819989:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000088d63091/0x2bc3aa892c3a68a5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581926.819994:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000088d63091/0x2bc3aa892c3a68a5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581926.820003:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000088d63091/0x2bc3aa892c3a68a5 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581926.820023:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000088d63091/0x2bc3aa892c3a68a5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581926.820027:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000088d63091/0x2bc3aa892c3a68a5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788581926.820040:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788581926.992028:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0510025 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+5:5824:x1875464020820224:12345-0@lo:253: Request processed in 198026us (198451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581926.992048:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581926.992185:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058b11025 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020820224:0@lo:253: 10000000:01000000:2.0:1788581926.992228:0:5824:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788581926.992232:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788581926.992234:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788581926.992235:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581926.992236:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788581926.992237:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581926.992238:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581926.992239:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788581926.992301:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788581926.992303:0:5824:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788581926.992305:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581926.992306:0:5824:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788581926.992326:0:5824:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f5f2db8d from lustre-MDT0000 10000000:01000000:2.0:1788581926.992350:0:5824:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788581926.992352:0:5824:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788581926.992356:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d0d9dde8000 10000000:01000000:2.0:1788581926.992359:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788581926.992366:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d0d9dde8000 from 1 10000000:01000000:2.0:1788581926.992369:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788581926.992408:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: 0000000088d63091/0x2bc3aa892c3a68ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581926.992420:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: 0000000088d63091/0x2bc3aa892c3a68ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581926.992449:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: 0000000088d63091/0x2bc3aa892c3a68ac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581926.992469:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000058b11025 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020820352:0@lo:101: 00000100:00100000:2.0:1788581926.992506:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581926.992556:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000001f5a04bd going to sleep for 11 seconds 00000100:00100000:0.0:1788581926.992636:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020820352 00000100:00100000:0.0:1788581926.992643:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020820352 00000100:00100000:0.0:1788581926.992691:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788581926.992700:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae7a195c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+5:5824:x1875464020820352:12345-0@lo:101: 00010000:00010000:0.0:1788581926.992712:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581926.992725:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000042658313/0x2bc3aa892c3a68b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a68ac expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581926.992746:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000042658313/0x2bc3aa892c3a68b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a68ac expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581926.992755:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000042658313/0x2bc3aa892c3a68b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a68ac expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581926.992764:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000042658313, rc 0) 00000100:00100000:0.0:1788581926.992817:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae7a195c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+6:5824:x1875464020820352:12345-0@lo:101: Request processed in 119us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581926.992823:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788581926.992911:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000058b11025 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020820352:0@lo:101: 00010000:00010000:1.0:1788581926.992925:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: 0000000088d63091/0x2bc3aa892c3a68ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a68b3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581926.992932:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: 0000000088d63091/0x2bc3aa892c3a68ac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a68b3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581926.992984:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038441149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020820480:0@lo:501: 00000100:00100000:1.0:1788581926.993008:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581926.993029:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000001ed16c5b going to sleep for 11 seconds 00000100:00100000:2.0:1788581926.993087:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020820480 00000100:00100000:2.0:1788581926.993091:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020820480 00000100:00100000:2.0:1788581926.993341:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788581926.993350:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000687493c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+6:5824:x1875464020820480:12345-0@lo:501: 00000100:00100000:2.0:1788581926.993564:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000687493c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+6:5824:x1875464020820480:12345-0@lo:501: Request processed in 216us (555us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788581926.993571:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788581926.993706:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038441149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020820480:0@lo:501: 10000000:01000000:1.0:1788581926.993731:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788581926.993751:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: 0000000088d63091/0x2bc3aa892c3a68ac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a68b3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581926.993765:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: 0000000088d63091/0x2bc3aa892c3a68ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a68b3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581926.993773:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d0d945e5800 10000000:01000000:1.0:1788581926.993776:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788581926.993780:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d0d945e5800 10000000:01000000:1.0:1788581926.993782:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788581926.993785:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d0d945e5800 from 1 10000000:01000000:1.0:1788581926.993787:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788581926.993804:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: 00000000a46b63bf/0x2bc3aa892c3a68ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581926.993811:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: 00000000a46b63bf/0x2bc3aa892c3a68ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581926.993818:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: 00000000a46b63bf/0x2bc3aa892c3a68ba lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581926.993828:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038441149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020820608:0@lo:101: 00000100:00100000:1.0:1788581926.993852:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581926.993882:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000001ed16c5b going to sleep for 11 seconds 00000100:00100000:1.0:1788581926.993896:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020820608 00000100:00100000:1.0:1788581926.993900:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020820608 00000100:00100000:1.0:1788581926.993930:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788581926.993935:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4e7a4c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+6:5824:x1875464020820608:12345-0@lo:101: 00010000:00010000:1.0:1788581926.993942:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581926.993952:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000426fcdf4/0x2bc3aa892c3a68c1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a68ba expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581926.993976:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000426fcdf4/0x2bc3aa892c3a68c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a68ba expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581926.993983:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000426fcdf4/0x2bc3aa892c3a68c1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a68ba expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581926.993990:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000426fcdf4, rc 0) 00000100:00100000:1.0:1788581926.994017:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4e7a4c4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+7:5824:x1875464020820608:12345-0@lo:101: Request processed in 82us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581926.994023:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788581926.994053:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038441149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020820608:0@lo:101: 00010000:00010000:1.0:1788581926.994062:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: 00000000a46b63bf/0x2bc3aa892c3a68ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a68c1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581926.994069:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: 00000000a46b63bf/0x2bc3aa892c3a68ba lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a68c1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581926.994078:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788581926.994080:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: 00000000a46b63bf/0x2bc3aa892c3a68ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a68c1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581926.994086:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: 00000000a46b63bf/0x2bc3aa892c3a68ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a68c1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581926.994091:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788581926.994094:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788581926.994098:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d0d945e5800 10000000:01000000:1.0:1788581926.994100:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788581926.994107:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788581926.994109:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788581926.994122:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: 0000000049190a04/0x2bc3aa892c3a68c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581926.994129:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: 0000000049190a04/0x2bc3aa892c3a68c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581926.994135:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: 0000000049190a04/0x2bc3aa892c3a68c8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581926.994146:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038441149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020820736:0@lo:101: 00000100:00100000:1.0:1788581926.994168:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581926.994180:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000001ed16c5b going to sleep for 11 seconds 00000100:00100000:1.0:1788581926.994192:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020820736 00000100:00100000:1.0:1788581926.994196:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020820736 00000100:00100000:1.0:1788581926.994229:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788581926.994235:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006a066496 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+7:5824:x1875464020820736:12345-0@lo:101: 00010000:00010000:1.0:1788581926.994355:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581926.994365:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000610e195d/0x2bc3aa892c3a68cf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a68c8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581926.994378:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000610e195d/0x2bc3aa892c3a68cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a68c8 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581926.994385:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000610e195d/0x2bc3aa892c3a68cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a68c8 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581926.994390:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000610e195d, rc 0) 00000100:00100000:1.0:1788581926.994416:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006a066496 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+8:5824:x1875464020820736:12345-0@lo:101: Request processed in 182us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581926.994429:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788581926.994459:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038441149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020820736:0@lo:101: 00010000:00010000:1.0:1788581926.994468:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: 0000000049190a04/0x2bc3aa892c3a68c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a68cf expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581926.994474:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: 0000000049190a04/0x2bc3aa892c3a68c8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a68cf expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581926.994506:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038441149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020820864:0@lo:501: 00000100:00100000:1.0:1788581926.994529:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581926.994546:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000001ed16c5b going to sleep for 11 seconds 00000100:00100000:1.0:1788581926.994558:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020820864 00000100:00100000:1.0:1788581926.994561:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020820864 00000100:00100000:1.0:1788581926.994580:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788581926.994585:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009070b97d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+8:5824:x1875464020820864:12345-0@lo:501: 00000100:00100000:1.0:1788581926.994756:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009070b97d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+9:5824:x1875464020820864:12345-0@lo:501: Request processed in 171us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581926.994764:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788581926.994805:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038441149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020820864:0@lo:501: 00000100:00100000:1.0:1788581926.994829:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038441149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020820992:0@lo:503: 00000100:00100000:1.0:1788581926.994877:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581926.994889:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000001ed16c5b going to sleep for 11 seconds 00000100:00100000:1.0:1788581926.994901:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020820992 00000100:00100000:1.0:1788581926.994904:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020820992 00000100:00100000:1.0:1788581926.994920:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788581926.994924:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9cc995f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+9:5824:x1875464020820992:12345-0@lo:503: 00000100:00100000:1.0:1788581926.995062:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9cc995f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+9:5824:x1875464020820992:12345-0@lo:503: Request processed in 137us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581926.995069:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788581926.995106:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038441149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020820992:0@lo:503: 00000100:00100000:3.0:1788581926.995683:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d90ae70 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5867:1875464020821120:0@lo:502: 00000100:00100000:3.0:1788581926.995729:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581926.995761:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set 000000003b3da8cc going to sleep for 11 seconds 00000100:00100000:1.0:1788581926.995816:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020821120 00000100:00100000:1.0:1788581926.995820:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020821120 00000100:00100000:1.0:1788581926.995852:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788581926.995878:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d00f168c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+9:5867:x1875464020821120:12345-0@lo:502: 00000100:00100000:1.0:1788581926.996045:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d00f168c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+9:5867:x1875464020821120:12345-0@lo:502: Request processed in 168us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581926.996052:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581926.996173:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d90ae70 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5867:1875464020821120:0@lo:502: 00000020:01000000:3.0:1788581926.996194:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581926.996226:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581926.996228:0:5867:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788581926.996234:0:5867:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788581926.996237:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788581926.996261:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000000e6399ee) 00000020:00000080:3.0:1788581926.996278:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788581926.996283:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788581926.996348:0:5867:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788581926.996363:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bc3aa892c3a68dd 00000020:00000080:3.0:1788581926.996573:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788581926.996578:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581926.996581:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581926.996583:0:5867:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788581926.996585:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581926.996588:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581926.996590:0:5867:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788581926.996592:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788581926.996599:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000bb31515b) 00000020:00000080:3.0:1788581926.996609:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788581926.996612:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788581926.996614:0:5867:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788581926.996616:0:5867:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788581926.996623:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788581926.996671:0:5867:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f5f2db8d from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788581926.996684:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000008005c387) 00000020:00000080:3.0:1788581926.996691:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788581926.996736:0:5867:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788581926.996741:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bc3aa892c3a68f2 00000020:00000080:3.0:1788581926.996828:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788581926.996834:0:5867:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788581926.996839:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2bc3aa892c3a68f9 00080000:01000000:3.0:1788581926.996843:0:5867:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788581926.996846:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bc3aa892c3a6900 00080000:10000000:3.0:1788581926.997251:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788581926.997445:0:5867:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788581927.001099:0:5867:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788581927.058791:0:5867:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788581927.059105:0:5867:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788581927.061343:0:5867:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788581927.061637:0:5867:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788581927.081650:0:5867:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000062f18b9f) 00000020:00000080:3.0:1788581927.081680:0:5867:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788581927.081743:0:5867:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788581927.081750:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bc3aa892c3a690e 00000020:00000080:3.0:1788581927.085574:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788581927.087021:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788581927.115800:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788581927.135874:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788581927.164037:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788581927.198181:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788581927.245037:0:5867:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:3.0:1788581927.275772:0:5867:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2bc3aa892c3a6915 00000020:00000080:2.0:1788581927.276466:0:5867:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788581927.276477:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581927.276482:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581927.276485:0:5867:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788581927.276488:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581927.276492:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581927.276493:0:5867:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788581927.276496:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788581927.276497:0:5867:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788581927.276499:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581927.276502:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581927.276503:0:5867:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788581927.276504:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581927.276508:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581927.276509:0:5867:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788581927.276513:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788581927.276556:0:5867:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1788581927.276609:0:5867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb1f199b pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5867:1875464020821248:0@lo:502: 00000100:00100000:2.0:1788581927.276685:0:5867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581927.276820:0:5867:0:(client.c:2715:ptlrpc_set_wait()) set 000000002026dc48 going to sleep for 11 seconds 00000100:00100000:0.0:1788581927.277002:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020821248 00000100:00100000:0.0:1788581927.277015:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020821248 00000100:00100000:0.0:1788581927.277064:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788581927.277073:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e39c73b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+9:5867:x1875464020821248:12345-0@lo:502: 00000100:00100000:0.0:1788581927.278557:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e39c73b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+9:5867:x1875464020821248:12345-0@lo:502: Request processed in 1479us (1867us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581927.278569:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788581927.278658:0:5867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb1f199b pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5867:1875464020821248:0@lo:502: 00000020:01000000:2.0:1788581927.278687:0:5867:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581927.278695:0:5867:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581927.278697:0:5867:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:2.0:1788581927.278702:0:5867:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1788581927.279040:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1788581927.279061:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788581927.279133:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: 0000000049190a04/0x2bc3aa892c3a68c8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a68cf expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581927.279143:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: 0000000049190a04/0x2bc3aa892c3a68c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a68cf expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581927.279151:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d0d945e5800 from 1 10000000:01000000:1.0:1788581927.279154:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788581927.279183:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: 000000004b63bae4/0x2bc3aa892c3a691c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581927.279190:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: 000000004b63bae4/0x2bc3aa892c3a691c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581927.279198:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: 000000004b63bae4/0x2bc3aa892c3a691c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581927.279261:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000038441149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020821376:0@lo:101: 00000100:00100000:1.0:1788581927.279298:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581927.279331:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f33a9470 going to sleep for 11 seconds 00000100:00100000:0.0:1788581927.279446:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020821376 00000100:00100000:0.0:1788581927.279454:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020821376 00000100:00100000:0.0:1788581927.279489:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788581927.279496:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c19dfa30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+9:5824:x1875464020821376:12345-0@lo:101: 00010000:00010000:0.0:1788581927.279507:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581927.279518:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bc511363/0x2bc3aa892c3a6923 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a691c expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581927.279538:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bc511363/0x2bc3aa892c3a6923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a691c expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581927.279546:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bc511363/0x2bc3aa892c3a6923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a691c expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581927.279553:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bc511363, rc 0) 00000100:00100000:0.0:1788581927.279588:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c19dfa30 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+10:5824:x1875464020821376:12345-0@lo:101: Request processed in 92us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581927.279594:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581927.279688:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000038441149 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020821376:0@lo:101: 00010000:00010000:2.0:1788581927.279701:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: 000000004b63bae4/0x2bc3aa892c3a691c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581927.279709:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: 000000004b63bae4/0x2bc3aa892c3a691c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581927.280441:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cb1f199b pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020821504:0@lo:256: 00000100:00100000:2.0:1788581927.280479:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581927.280542:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000002026dc48 going to sleep for 11 seconds 00000100:00100000:0.0:1788581927.280661:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020821504 00000100:00100000:0.0:1788581927.280667:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020821504 00000100:00100000:0.0:1788581927.280706:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788581927.280713:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2a5a769 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+10:5824:x1875464020821504:12345-0@lo:256: 20000000:01000000:0.0:1788581927.280727:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788581927.280749:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788581927.280822:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2a5a769 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+10:5824:x1875464020821504:12345-0@lo:256: Request processed in 110us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581927.280829:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788581927.280989:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cb1f199b pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020821504:0@lo:256: 10000000:01000000:3.0:1788581927.281725:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788581927.281787:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: 000000004b63bae4/0x2bc3aa892c3a691c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581927.281796:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: 000000004b63bae4/0x2bc3aa892c3a691c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581927.282056:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0d945e5800 from 1 10000000:01000000:3.0:1788581927.282060:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788581927.282101:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: 0000000087216b14/0x2bc3aa892c3a692a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581927.282119:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: 0000000087216b14/0x2bc3aa892c3a692a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581927.282130:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: 0000000087216b14/0x2bc3aa892c3a692a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581927.282149:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d90ae70 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020821632:0@lo:101: 00000100:00100000:3.0:1788581927.282197:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581927.282257:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ce3c5c4 going to sleep for 11 seconds 00000100:00100000:0.0:1788581927.282372:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020821632 00000100:00100000:0.0:1788581927.282379:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020821632 00000100:00100000:0.0:1788581927.282426:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788581927.282434:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008fa5fdd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+10:5824:x1875464020821632:12345-0@lo:101: 00010000:00010000:0.0:1788581927.282446:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581927.282459:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000059339f0e/0x2bc3aa892c3a6931 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a692a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581927.282478:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000059339f0e/0x2bc3aa892c3a6931 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a692a expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581927.282487:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000059339f0e/0x2bc3aa892c3a6931 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a692a expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581927.282496:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000059339f0e, rc 0) 00000100:00100000:0.0:1788581927.282541:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008fa5fdd8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:5824:x1875464020821632:12345-0@lo:101: Request processed in 109us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581927.282549:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788581927.282665:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d90ae70 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020821632:0@lo:101: 00010000:00010000:3.0:1788581927.282678:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: 0000000087216b14/0x2bc3aa892c3a692a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581927.282686:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: 0000000087216b14/0x2bc3aa892c3a692a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581927.282735:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d90ae70 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020821760:0@lo:501: 00000100:00100000:3.0:1788581927.282757:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581927.282784:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ce3c5c4 going to sleep for 11 seconds 00000100:00100000:1.0:1788581927.282837:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020821760 00000100:00100000:1.0:1788581927.282842:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020821760 00000100:00100000:1.0:1788581927.282881:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788581927.282886:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003155ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:5824:x1875464020821760:12345-0@lo:501: 00000100:00100000:1.0:1788581927.283656:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003155ab5c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:5824:x1875464020821760:12345-0@lo:501: Request processed in 768us (896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581927.283664:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788581927.283809:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d90ae70 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020821760:0@lo:501: 00000100:00100000:3.0:1788581927.283842:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d90ae70 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020821888:0@lo:503: 00000100:00100000:3.0:1788581927.283892:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581927.283922:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ce3c5c4 going to sleep for 11 seconds 00000100:00100000:1.0:1788581927.283998:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020821888 00000100:00100000:1.0:1788581927.284004:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020821888 00000100:00100000:1.0:1788581927.284041:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788581927.284048:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000627b0ebe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:5824:x1875464020821888:12345-0@lo:503: 00000040:00080000:1.0:1788581927.284081:0:5838:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788581927.284112:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000627b0ebe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:5824:x1875464020821888:12345-0@lo:503: Request processed in 65us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581927.284118:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788581927.284196:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d90ae70 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020821888:0@lo:503: 00000040:00080000:1.0:1788581927.285475:0:5871:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788581927.285680:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788581927.285707:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788581927.285723:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: 0000000087216b14/0x2bc3aa892c3a692a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581927.285734:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: 0000000087216b14/0x2bc3aa892c3a692a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581927.285770:0:5824:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788581927.285772:0:5824:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d0d945e5800 10000000:01000000:3.0:1788581927.285775:0:5824:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d0d945e5800 10000000:01000000:3.0:1788581927.285778:0:5824:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788581927.285784:0:5824:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0d945e5800 from 1 10000000:01000000:3.0:1788581927.285786:0:5824:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788581927.285813:0:5824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: 00000000f0756470/0x2bc3aa892c3a6938 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581927.285821:0:5824:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: 00000000f0756470/0x2bc3aa892c3a6938 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581927.285831:0:5824:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: 00000000f0756470/0x2bc3aa892c3a6938 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581927.285848:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d90ae70 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020822016:0@lo:101: 00000100:00100000:3.0:1788581927.285909:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581927.286059:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058434f73 going to sleep for 11 seconds 00000100:00100000:0.0:1788581927.286119:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020822016 00000100:00100000:0.0:1788581927.286126:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020822016 00000100:00100000:0.0:1788581927.286162:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788581927.286169:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002eaebf10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:5824:x1875464020822016:12345-0@lo:101: 00010000:00010000:0.0:1788581927.286179:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581927.286189:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d5ead2cd/0x2bc3aa892c3a693f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6938 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581927.286417:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d5ead2cd/0x2bc3aa892c3a693f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6938 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581927.286426:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d5ead2cd/0x2bc3aa892c3a693f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6938 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581927.286435:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d5ead2cd, rc 0) 00000100:00100000:0.0:1788581927.286473:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002eaebf10 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:5824:x1875464020822016:12345-0@lo:101: Request processed in 305us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581927.286479:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788581927.286549:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d90ae70 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020822016:0@lo:101: 00010000:00010000:3.0:1788581927.286560:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: 00000000f0756470/0x2bc3aa892c3a6938 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a693f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581927.286567:0:5824:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: 00000000f0756470/0x2bc3aa892c3a6938 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a693f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581927.286611:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d90ae70 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020822144:0@lo:501: 00000100:00100000:3.0:1788581927.286633:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581927.286657:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058434f73 going to sleep for 11 seconds 00000100:00100000:0.0:1788581927.286701:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020822144 00000100:00100000:0.0:1788581927.286705:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020822144 00000100:00100000:0.0:1788581927.286729:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788581927.286734:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f27c55d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:5824:x1875464020822144:12345-0@lo:501: 00000100:00100000:0.0:1788581927.287297:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f27c55d9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:5824:x1875464020822144:12345-0@lo:501: Request processed in 503us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581927.287305:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788581927.287377:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d90ae70 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020822144:0@lo:501: 00000100:00100000:3.0:1788581927.287403:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d90ae70 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020822272:0@lo:503: 00000100:00100000:3.0:1788581927.287435:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581927.287459:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 0000000058434f73 going to sleep for 11 seconds 00000100:00100000:0.0:1788581927.287503:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020822272 00000100:00100000:0.0:1788581927.287507:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020822272 00000100:00100000:0.0:1788581927.287540:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788581927.287546:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fa5943e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:5824:x1875464020822272:12345-0@lo:503: 00000100:00100000:0.0:1788581927.287840:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fa5943e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:5824:x1875464020822272:12345-0@lo:503: Request processed in 293us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581927.287847:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788581927.288081:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d90ae70 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020822272:0@lo:503: 00000100:00100000:1.0:1788581927.288714:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000679379a pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5872:1875464020822400:0@lo:502: 00000100:00100000:1.0:1788581927.288758:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581927.288781:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b3aca94a going to sleep for 11 seconds 00000100:00100000:0.0:1788581927.288978:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020822400 00000100:00100000:0.0:1788581927.288983:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020822400 00000100:00100000:0.0:1788581927.289057:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788581927.289073:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bdfde5e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:5872:x1875464020822400:12345-0@lo:502: 00000100:00100000:0.0:1788581927.289344:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bdfde5e8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:5872:x1875464020822400:12345-0@lo:502: Request processed in 271us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581927.289351:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788581927.289549:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000679379a pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5872:1875464020822400:0@lo:502: 00000020:01000004:3.0:1788581927.289620:0:5872:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788581927.289635:0:5872:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000b3a52786) 00000020:00000080:3.0:1788581927.289652:0:5872:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788581927.289721:0:5872:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f5f2db8d from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788581927.289725:0:5872:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000f5f2db8d from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788581927.289727:0:5872:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000f5f2db8d 4 00010000:00080000:3.0:1788581927.289751:0:5872:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000c154f6ba@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.112@tcp at head 00010000:00010000:3.0:1788581927.291436:0:5872:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788581927.291618:0:5872:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788581927.291651:0:5872:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788581927.291665:0:5872:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2bc3aa892c3a694d 00000100:00080000:3.0:1788581927.291676:0:5872:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788581927.291680:0:5872:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c154f6ba using connection 192.168.201.112@tcp/0@lo 00000100:00100000:3.0:1788581927.291714:0:5872:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000007d90ae70 x1875464020822528/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788581927.291756:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d90ae70 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875464020822528:0@lo:38: 00000100:00100000:3.0:1788581927.291827:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581927.291904:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020822528 00000100:00100000:3.0:1788581927.291911:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020822528 00000100:00100000:3.0:1788581927.291939:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581927.291946:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f729fb0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875464020822528:12345-0@lo:38: 00000100:00100000:3.0:1788581927.291993:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f729fb0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875464020822528:12345-0@lo:38: Request processed in 46us (166us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788581927.292000:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581927.292033:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788581927.292040:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000c154f6ba lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788581927.292055:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788581927.292058:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d90ae70 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875464020822528:0@lo:38: 00000100:00080000:3.0:1788581927.292085:0:5872:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788581927.296622:0:5872:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d90ae70 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5872:1875464020822656:0@lo:502: 00000100:00100000:3.0:1788581927.296706:0:5872:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581927.296749:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020822656 00000100:00100000:3.0:1788581927.296757:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020822656 00000100:00100000:3.0:1788581927.296800:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788581927.296810:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000015259b96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:5872:x1875464020822656:12345-0@lo:502: 00000100:00100000:3.0:1788581927.297068:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000015259b96 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:5872:x1875464020822656:12345-0@lo:502: Request processed in 259us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581927.297077:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788581927.297137:0:5872:0:(client.c:2715:ptlrpc_set_wait()) set 000000006270acd6 going to sleep for 11 seconds 00000100:00100000:3.0:1788581927.297158:0:5872:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d90ae70 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5872:1875464020822656:0@lo:502: 00000040:00080000:3.0:1788581927.297187:0:5872:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1788581927.298311:0:5824:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788581927.298342:0:5824:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788581927.298359:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: 00000000f0756470/0x2bc3aa892c3a6938 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a693f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581927.298371:0:5824:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: 00000000f0756470/0x2bc3aa892c3a6938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a693f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788581927.298416:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788581927.298418:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788581927.298419:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581927.298420:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581927.298421:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581927.298422:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581927.298424:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788581927.298425:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788581927.298426:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788581927.298427:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788581927.298429:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581927.298430:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788581927.298433:0:5824:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788581927.298435:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788581927.298437:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788581927.298437:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581927.298438:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581927.298439:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581927.298440:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581927.298441:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788581927.298442:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788581927.298443:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788581927.298443:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788581927.298444:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581927.298445:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788581927.298464:0:5824:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788581927.298477:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d90ae70 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020822784:0@lo:253: 00000100:00100000:3.0:1788581927.298522:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581927.298558:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set 000000007ce3c5c4 going to sleep for 11 seconds 00000100:00100000:1.0:1788581927.301392:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020822784 00000100:00100000:1.0:1788581927.301408:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020822784 00000100:00100000:1.0:1788581927.301495:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788581927.301504:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1d62397 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:5824:x1875464020822784:12345-0@lo:253: 20000000:01000000:1.0:1788581927.301543:0:5838:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788581927.301555:0:5838:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788581927.332492:0:5838:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788581927.332514:0:5838:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788581927.332697:0:5859:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788581927.332703:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788581927.332722:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000cb30ca78/0x2bc3aa892c3a6954 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581927.332741:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000bc511363/0x2bc3aa892c3a6923 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a691c expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581927.332748:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000cb30ca78/0x2bc3aa892c3a6954 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581927.332803:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000bc511363/0x2bc3aa892c3a6923 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a691c expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581927.332817:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000bc511363/0x2bc3aa892c3a6923 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a691c expref: 12 pid: 5838 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581927.332831:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc103680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1875464020822912:0@lo:104: 00000100:00100000:2.0:1788581927.332909:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581927.332958:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a178dfa1 going to sleep for 11 seconds 00000100:00100000:1.0:1788581927.333481:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020822912 00000100:00100000:1.0:1788581927.333492:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020822912 00000100:00100000:1.0:1788581927.333546:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581927.333554:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002bd024cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:5859:x1875464020822912:12345-0@lo:104: 00010000:00010000:1.0:1788581927.333565:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: 000000004b63bae4/0x2bc3aa892c3a691c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581927.333622:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788581927.333627:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002bd024cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:5859:x1875464020822912:12345-0@lo:104: Request processed in 74us (719us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581927.333634:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788581927.333654:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581927.333658:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: 000000004b63bae4/0x2bc3aa892c3a691c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581927.333665:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000004b63bae4 already unused, calling callback (0000000011987bb5) 10000000:00010000:1.0:1788581927.333668:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: 000000004b63bae4/0x2bc3aa892c3a691c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a6923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581927.333675:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: 000000004b63bae4/0x2bc3aa892c3a691c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a6923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581927.333681:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: 000000004b63bae4/0x2bc3aa892c3a691c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a6923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581927.333686:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581927.333718:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: 000000004b63bae4/0x2bc3aa892c3a691c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581927.333724:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581927.333739:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: 000000004b63bae4/0x2bc3aa892c3a691c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581927.333745:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: 000000004b63bae4/0x2bc3aa892c3a691c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6923 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581927.333761:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581927.333763:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581927.333764:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581927.333812:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000430bd7d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020823040:0@lo:103: 00000100:00100000:1.0:1788581927.333840:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581927.333916:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020823040 00000100:00100000:1.0:1788581927.333921:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020823040 00010000:00010000:1.0:1788581927.333937:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000bc511363/0x2bc3aa892c3a6923 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a691c expref: 13 pid: 5838 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581927.333957:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581927.333963:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d6929739 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:3307:x1875464020823040:12345-0@lo:103: 00010000:00010000:1.0:1788581927.333972:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581927.333976:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000bc511363/0x2bc3aa892c3a6923 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a691c expref: 13 pid: 5838 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581927.333985:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000bc511363/0x2bc3aa892c3a6923 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a691c expref: 13 pid: 5838 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581927.334000:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000cb30ca78/0x2bc3aa892c3a6954 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581927.334012:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb30ca78/0x2bc3aa892c3a6954 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788581927.334026:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001323415s 00010000:00010000:1.0:1788581927.334030:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cb30ca78/0x2bc3aa892c3a6954 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581927.334036:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000cb30ca78/0x2bc3aa892c3a6954 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581927.334042:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000cb30ca78/0x2bc3aa892c3a6954 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581927.334048:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000cb30ca78/0x2bc3aa892c3a6954 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581927.334053:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000cb30ca78 already unused, calling callback (00000000732149c4) 00010000:00010000:1.0:1788581927.334056:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000cb30ca78/0x2bc3aa892c3a6954 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581927.334062:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000cb30ca78/0x2bc3aa892c3a6954 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581927.334068:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000cb30ca78/0x2bc3aa892c3a6954 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581927.334077:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581927.334104:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d6929739 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:3307:x1875464020823040:12345-0@lo:103: Request processed in 141us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581927.334111:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581927.334152:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000430bd7d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020823040:0@lo:103: 00010000:00010000:3.0:1788581927.334418:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bc511363/0x2bc3aa892c3a6923 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a691c expref: 12 pid: 5838 timeout: 296 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581927.334437:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc103680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1875464020822912:0@lo:104: 00010000:00010000:3.0:1788581927.334450:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000cb30ca78/0x2bc3aa892c3a6954 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581927.334458:0:5859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000cb30ca78/0x2bc3aa892c3a6954 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581927.334463:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000cb30ca78/0x2bc3aa892c3a6954 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581927.334469:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000cb30ca78/0x2bc3aa892c3a6954 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581927.344572:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1d62397 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:5824:x1875464020822784:12345-0@lo:253: Request processed in 43061us (46042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581927.344587:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788581927.344685:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d90ae70 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5824:1875464020822784:0@lo:253: 10000000:01000000:3.0:1788581927.344701:0:5824:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788581927.344704:0:5824:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788581927.344706:0:5824:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788581927.344707:0:5824:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581927.344709:0:5824:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581927.344710:0:5824:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581927.344712:0:5824:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581927.344713:0:5824:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788581927.344715:0:5824:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788581927.344716:0:5824:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788581927.344717:0:5824:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788581927.344719:0:5824:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581927.344720:0:5824:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788581927.344734:0:5824:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788581927.351772:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788581927.352424:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788581927.352625:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788581927.352823:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788581927.353050:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788581927.353389:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788581927.354367:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788581927.354550:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788581927.354772:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788581927.355020:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788581927.355382:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788581927.355584:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:2.0:1788581927.395002:0:5824:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1788581927.436865:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788581927.436930:0:5877:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788581927.436933:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1788581927.437184:0:5878:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788581927.447305:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788581927.447640:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788581927.449431:0:5824:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788581927.449448:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788581927.449808:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788581927.454589:0:5824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788581927.456778:0:5824:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788581927.456832:0:5824:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788581927.457100:0:5824:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788581927.457437:0:5824:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1788581927.462011:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788581927.462161:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788581927.462568:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788581927.462914:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788581927.463049:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788581927.463180:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788581927.463439:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788581927.463597:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788581927.463910:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788581927.464072:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788581927.464462:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788581927.464614:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788581927.464777:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788581927.464943:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788581927.465096:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1788581927.465511:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1788581927.467484:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1788581927.467640:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1788581927.468100:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1788581927.468444:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:0.0:1788581927.468611:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:0.0:1788581927.468830:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:0.0:1788581927.469001:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:0.0:1788581927.469150:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788581927.471509:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1788581927.471691:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788581927.474330:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1788581927.474609:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1788581927.474766:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788581927.474950:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788581927.475129:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788581927.475304:0:5824:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788581927.475517:0:5824:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1788581927.486957:0:5878:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788581927.549659:0:5824:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788581927.549696:0:5824:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa64381d67988 00100000:10000000:3.0:1788581927.549705:0:5824:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000040:00080000:2.0:1788581927.552014:0:5878:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788581927.552099:0:5878:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788581927.552103:0:5878:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:01000004:3.0:1788581927.553045:0:5824:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788581927.553061:0:5824:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.112@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788581927.553075:0:5824:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1788581927.553091:0:5824:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:1.0:1788581927.667468:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581928.691722:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581929.711351:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581930.734757:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581931.766577:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788581932.441666:0:6121:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg112-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788581932.528618:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788581932.528628:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788581932.528630:0:8:0:(import.c:65:import_set_state_nolock()) 00000000c154f6ba lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788581932.528644:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000c154f6ba using connection 192.168.201.112@tcp/0@lo 00000100:00100000:1.0:1788581932.528664:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000e255e84 x1875464020823296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788581932.528741:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581932.528754:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000430bd7d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020823168:0@lo:400: 00000100:00100000:1.0:1788581932.528832:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581932.528883:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000e255e84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875464020823296:0@lo:38: 00000100:00100000:1.0:1788581932.528913:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581932.528951:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020823168 00000100:00100000:1.0:1788581932.528958:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020823168 00000100:00100000:1.0:1788581932.529006:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788581932.529015:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c7239236 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:3309:x1875464020823168:12345-0@lo:400: 00000100:00100000:1.0:1788581932.529063:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c7239236 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:3309:x1875464020823168:12345-0@lo:400: Request processed in 49us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581932.529069:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788581932.529122:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000430bd7d1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020823168:0@lo:400: 00000100:00100000:3.0:1788581932.529324:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020823296 00000100:00100000:3.0:1788581932.529329:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020823296 00000100:00100000:3.0:1788581932.529356:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788581932.529360:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000063455e82 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1875464020823296:12345-0@lo:38: 00010000:00080000:3.0:1788581932.529451:0:5845:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 151 last 0 00000020:00000080:3.0:1788581932.529489:0:5845:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2bc3aa892c3a695b 00000004:00100000:3.0:1788581932.529548:0:5845:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788581932.529661:0:5845:0:(import.c:65:import_set_state_nolock()) 00000000d718b60b : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581932.529705:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000063455e82 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875464020823296:12345-0@lo:38: Request processed in 343us (791us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581932.529712:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788581932.530834:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000000e255e84 x1875464020823296/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788581932.530860:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788581932.530867:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788581932.530872:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788581932.530875:0:3305:0:(import.c:65:import_set_state_nolock()) 00000000c154f6ba lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788581932.530881:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000e255e84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875464020823296:0@lo:38: 00010000:00010000:3.0:1788581932.781540:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788581933.550501:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788581933.550509:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d0d945e5800 from 3 10000000:01000000:3.0:1788581933.550514:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788581933.550819:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: 00000000840c4019/0x2bc3aa892c3a6962 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581933.550834:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: 00000000840c4019/0x2bc3aa892c3a6962 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581933.550847:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: 00000000840c4019/0x2bc3aa892c3a6962 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581933.550871:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007d90ae70 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020823424:0@lo:101: 00000100:00100000:3.0:1788581933.550938:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581933.550994:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a6ea7fde going to sleep for 11 seconds 00000100:00100000:0.0:1788581933.551871:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020823424 00000100:00100000:0.0:1788581933.551882:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020823424 00000100:00100000:0.0:1788581933.551946:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788581933.551955:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0e3ba16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:5840:x1875464020823424:12345-0@lo:101: 00010000:00010000:0.0:1788581933.551971:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581933.551988:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dedf33c2/0x2bc3aa892c3a6969 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6962 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581933.552012:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dedf33c2/0x2bc3aa892c3a6969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6962 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581933.552022:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dedf33c2/0x2bc3aa892c3a6969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6962 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581933.552039:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dedf33c2, rc 0) 00000100:00100000:0.0:1788581933.552113:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0e3ba16 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:5840:x1875464020823424:12345-0@lo:101: Request processed in 158us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581933.552120:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788581933.552139:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007d90ae70 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020823424:0@lo:101: 00010000:00010000:2.0:1788581933.552156:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: 00000000840c4019/0x2bc3aa892c3a6962 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6969 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581933.552166:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: 00000000840c4019/0x2bc3aa892c3a6962 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6969 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581933.552296:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020e49941 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020823552:0@lo:256: 00000100:00100000:2.0:1788581933.552337:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581933.552404:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c3a934f0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581933.552440:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020823552 00000100:00100000:1.0:1788581933.552445:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020823552 00000100:00100000:1.0:1788581933.552509:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788581933.552518:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ca0cf07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:5840:x1875464020823552:12345-0@lo:256: 20000000:01000000:1.0:1788581933.552532:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788581933.552549:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788581933.552553:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788581933.552637:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ca0cf07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:5840:x1875464020823552:12345-0@lo:256: Request processed in 121us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581933.552645:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788581933.552773:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020e49941 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020823552:0@lo:256: 10000000:01000000:2.0:1788581933.552815:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788581933.552822:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: 00000000840c4019/0x2bc3aa892c3a6962 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6969 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581933.552909:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: 00000000840c4019/0x2bc3aa892c3a6962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6969 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581933.807588:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581934.830005:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581935.853733:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581936.880048:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788581937.139193:0:6322:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe57b9ad50 20000000:00000080:2.0:1788581937.139235:0:6322:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d0da7926000 uarg=0000000000000000 20000000:01000000:2.0:1788581937.139267:0:6322:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788581937.139274:0:6322:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788581937.139278:0:6322:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788581937.140744:0:6322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1788581937.140761:0:6322:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1788581937.151097:0:6322:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788581937.151426:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788581937.151703:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1788581937.151762:0:6322:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1788581937.151780:0:6322:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788581937.151796:0:6322:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003daf7b9e/0x2bc3aa892c3a6970 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581937.151815:0:6322:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000059339f0e/0x2bc3aa892c3a6931 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a692a expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581937.151822:0:6322:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003daf7b9e/0x2bc3aa892c3a6970 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581937.151860:0:6322:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000059339f0e/0x2bc3aa892c3a6931 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a692a expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581937.151875:0:6322:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000059339f0e/0x2bc3aa892c3a6931 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a692a expref: 11 pid: 5836 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581937.151902:0:6322:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000020e49941 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6322:1875464020823680:0@lo:104: 00000100:00100000:2.0:1788581937.151966:0:6322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581937.152084:0:6322:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bb6425cf going to sleep for 11 seconds 00000100:00100000:0.0:1788581937.164088:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020823680 00000100:00100000:0.0:1788581937.164107:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020823680 00000100:00100000:0.0:1788581937.164193:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788581937.164593:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000464e1ace pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:6322:x1875464020823680:12345-0@lo:104: 00010000:00010000:0.0:1788581937.164612:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: 0000000087216b14/0x2bc3aa892c3a692a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581937.164717:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581937.164723:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000464e1ace pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:6322:x1875464020823680:12345-0@lo:104: Request processed in 523us (12757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581937.164730:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581937.164806:0:6322:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000020e49941 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6322:1875464020823680:0@lo:104: 00010000:00010000:2.0:1788581937.164826:0:6322:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003daf7b9e/0x2bc3aa892c3a6970 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581937.164877:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581937.164882:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: 0000000087216b14/0x2bc3aa892c3a692a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581937.164891:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000087216b14 already unused, calling callback (0000000011987bb5) 10000000:00010000:1.0:1788581937.164894:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: 0000000087216b14/0x2bc3aa892c3a692a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a6931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581937.164902:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: 0000000087216b14/0x2bc3aa892c3a692a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a6931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581937.164926:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: 0000000087216b14/0x2bc3aa892c3a692a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a6931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581937.164932:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788581937.164984:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: 0000000087216b14/0x2bc3aa892c3a692a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581937.164991:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581937.165018:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: 0000000087216b14/0x2bc3aa892c3a692a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581937.165032:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: 0000000087216b14/0x2bc3aa892c3a692a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6931 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581937.165051:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581937.165053:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581937.165054:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000e255e84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020823808:0@lo:103: 00010000:00010000:1.0:1788581937.165054:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581937.165094:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581937.165248:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020823808 00000100:00100000:1.0:1788581937.165253:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020823808 00010000:00010000:1.0:1788581937.165273:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000059339f0e/0x2bc3aa892c3a6931 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a692a expref: 12 pid: 5836 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581937.165299:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788581937.165305:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e0435cc1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:3309:x1875464020823808:12345-0@lo:103: 00010000:00010000:1.0:1788581937.165314:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581937.165318:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000059339f0e/0x2bc3aa892c3a6931 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a692a expref: 12 pid: 5836 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581937.165328:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000059339f0e/0x2bc3aa892c3a6931 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a692a expref: 12 pid: 5836 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581937.165345:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000059339f0e/0x2bc3aa892c3a6931 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a692a expref: 12 pid: 5836 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581937.165356:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003daf7b9e/0x2bc3aa892c3a6970 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581937.165363:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003daf7b9e/0x2bc3aa892c3a6970 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581937.165375:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003daf7b9e/0x2bc3aa892c3a6970 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581937.165380:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003daf7b9e/0x2bc3aa892c3a6970 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581937.165386:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003daf7b9e/0x2bc3aa892c3a6970 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581937.165391:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003daf7b9e/0x2bc3aa892c3a6970 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581937.165396:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003daf7b9e already unused, calling callback (00000000732149c4) 00010000:00010000:1.0:1788581937.165399:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003daf7b9e/0x2bc3aa892c3a6970 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581937.165405:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003daf7b9e/0x2bc3aa892c3a6970 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581937.165419:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003daf7b9e/0x2bc3aa892c3a6970 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581937.165438:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581937.165489:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e0435cc1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:3309:x1875464020823808:12345-0@lo:103: Request processed in 185us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581937.165496:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581937.165571:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000e255e84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020823808:0@lo:103: 00010000:00010000:3.0:1788581937.165659:0:6322:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003daf7b9e/0x2bc3aa892c3a6970 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581937.165666:0:6322:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003daf7b9e/0x2bc3aa892c3a6970 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581937.165670:0:6322:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003daf7b9e/0x2bc3aa892c3a6970 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6322 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581937.648004:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581937.649623:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000084ffd35b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875464020823936:0@lo:400: 00000100:00100000:2.0:1788581937.649712:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581937.649808:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020823936 00000100:00100000:3.0:1788581937.649817:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020823936 00000100:00100000:3.0:1788581937.649872:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581937.649880:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020e49941 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875464020823936:12345-0@lo:400: 00000100:00100000:3.0:1788581937.649937:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020e49941 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875464020823936:12345-0@lo:400: Request processed in 59us (226us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581937.649944:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788581937.650017:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000084ffd35b x1875464020823936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581937.650031:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000084ffd35b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875464020823936:0@lo:400: 00010000:00010000:3.0:1788581937.913450:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581938.926227:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581939.960779:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581940.973379:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788581941.741478:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788581941.741490:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0d945e5800 from 1 10000000:01000000:2.0:1788581941.741497:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788581941.741560:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: 00000000571ee37d/0x2bc3aa892c3a6977 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581941.741574:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: 00000000571ee37d/0x2bc3aa892c3a6977 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581941.741588:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: 00000000571ee37d/0x2bc3aa892c3a6977 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581941.741633:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ef502a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020824064:0@lo:101: 00000100:00100000:2.0:1788581941.741747:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581941.741821:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set 00000000235b55c7 going to sleep for 11 seconds 00000100:00100000:0.0:1788581941.741904:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020824064 00000100:00100000:0.0:1788581941.741918:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020824064 00000100:00100000:0.0:1788581941.742003:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788581941.742014:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000a32cd5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:5840:x1875464020824064:12345-0@lo:101: 00010000:00010000:0.0:1788581941.742033:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581941.742050:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000032bb0585/0x2bc3aa892c3a697e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6977 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581941.742078:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000032bb0585/0x2bc3aa892c3a697e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6977 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581941.742097:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000032bb0585/0x2bc3aa892c3a697e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6977 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581941.742108:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000032bb0585, rc 0) 00000100:00100000:0.0:1788581941.742166:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000a32cd5e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:5840:x1875464020824064:12345-0@lo:101: Request processed in 155us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581941.742174:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788581941.742340:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ef502a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020824064:0@lo:101: 00010000:00010000:2.0:1788581941.742358:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: 00000000571ee37d/0x2bc3aa892c3a6977 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a697e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581941.742367:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: 00000000571ee37d/0x2bc3aa892c3a6977 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a697e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581941.742431:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ef502a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020824192:0@lo:501: 00000100:00100000:2.0:1788581941.742460:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581941.742487:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set 00000000235b55c7 going to sleep for 11 seconds 00000100:00100000:0.0:1788581941.742530:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020824192 00000100:00100000:0.0:1788581941.742534:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020824192 00000100:00100000:0.0:1788581941.742570:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788581941.742577:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034c0e816 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:5840:x1875464020824192:12345-0@lo:501: 00000100:00100000:0.0:1788581941.742893:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034c0e816 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:5840:x1875464020824192:12345-0@lo:501: Request processed in 316us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581941.742901:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788581941.742934:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ef502a3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020824192:0@lo:501: 00000100:00100000:0.0:1788581941.742986:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a9bcdb27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020824320:0@lo:503: 00000100:00100000:0.0:1788581941.743023:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581941.743035:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ba42c30a going to sleep for 11 seconds 00000100:00100000:0.0:1788581941.743046:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020824320 00000100:00100000:0.0:1788581941.743049:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020824320 00000100:00100000:0.0:1788581941.743066:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788581941.743070:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a3fe06c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:5840:x1875464020824320:12345-0@lo:503: 00000100:00100000:0.0:1788581941.743256:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a3fe06c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:5840:x1875464020824320:12345-0@lo:503: Request processed in 185us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581941.743263:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788581941.743306:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a9bcdb27 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020824320:0@lo:503: 00000100:00100000:0.0:1788581941.743843:0:6636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a9bcdb27 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6636:1875464020824448:0@lo:502: 00000100:00100000:0.0:1788581941.743883:0:6636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581941.743909:0:6636:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d7ee0459 going to sleep for 11 seconds 00000100:00100000:1.0:1788581941.743950:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020824448 00000100:00100000:1.0:1788581941.743955:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020824448 00000100:00100000:1.0:1788581941.744025:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788581941.744031:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000da0fad0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:6636:x1875464020824448:12345-0@lo:502: 00000100:00100000:1.0:1788581941.744237:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000da0fad0f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:6636:x1875464020824448:12345-0@lo:502: Request processed in 206us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581941.744248:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788581941.744332:0:6636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a9bcdb27 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6636:1875464020824448:0@lo:502: 00000020:01000000:0.0:1788581941.744360:0:6636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581941.744372:0:6636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581941.744375:0:6636:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788581941.744385:0:6636:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d0d945e5800 00000020:00000080:0.0:1788581941.744387:0:6636:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788581941.744433:0:6636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6636:1875464020824576:0@lo:502: 00000100:00100000:0.0:1788581941.744473:0:6636:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581941.744786:0:6636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8a934600 going to sleep for 11 seconds 00000100:00100000:2.0:1788581941.744861:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020824576 00000100:00100000:2.0:1788581941.744866:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020824576 00000100:00100000:2.0:1788581941.744893:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788581941.744899:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:6636:x1875464020824576:12345-0@lo:502: 00000100:00100000:2.0:1788581941.745166:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:6636:x1875464020824576:12345-0@lo:502: Request processed in 265us (692us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581941.745174:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788581941.745350:0:6636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6636:1875464020824576:0@lo:502: 00000020:01000000:0.0:1788581941.745373:0:6636:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581941.745381:0:6636:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581941.745383:0:6636:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788581941.745388:0:6636:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788581941.756536:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788581941.756588:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788581941.756615:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f400/0x2bc3aa892c3a6977 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a697e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581941.756631:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f400/0x2bc3aa892c3a6977 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a697e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581941.997950:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581942.765677:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020824832:0@lo:400: 00000100:00100000:0.0:1788581942.765783:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581942.765923:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020824832 00000100:00100000:0.0:1788581942.765945:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020824832 00000100:00100000:0.0:1788581942.766025:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788581942.766037:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020824832:12345-0@lo:400: 00000100:00100000:0.0:1788581942.766096:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020824832:12345-0@lo:400: Request processed in 62us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581942.766104:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788581942.766171:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d0da702ce00 x1875464020824832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581942.766188:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020824832:0@lo:400: 00000100:00100000:3.0:1788581942.766882:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581942.766903:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020824704:0@lo:400: 00000100:00100000:3.0:1788581942.766982:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581942.767872:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020824704 00000100:00100000:0.0:1788581942.767885:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020824704 00000100:00100000:0.0:1788581942.767964:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788581942.768129:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3332c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:3306:x1875464020824704:12345-0@lo:400: 00000100:00100000:0.0:1788581942.768403:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3332c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:3306:x1875464020824704:12345-0@lo:400: Request processed in 429us (1419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581942.768412:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788581942.768510:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020824704:0@lo:400: 00010000:00010000:2.0:1788581943.021470:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788581943.350991:0:6688:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788581943.350996:0:6688:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1788581943.351318:0:6688:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d0dac39a800 00000020:01000004:2.0:1788581943.351340:0:6688:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788581943.351354:0:6688:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788581943.351372:0:6688:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d0d9dde99b8) 00000020:00000080:2.0:1788581943.351394:0:6688:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788581943.372770:0:6688:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788581943.373527:0:6688:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1788581943.416364:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1788581943.424795:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1788581943.424823:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1788581943.424862:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1788581943.424887:0:6688:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1788581943.425227:0:6688:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788581943.425236:0:6688:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788581943.425245:0:6688:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2bc3aa892c3a698c 00000020:01000004:3.0:1788581943.425251:0:6688:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1788581943.425271:0:6688:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.112@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788581943.425274:0:6688:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788581943.425278:0:6688:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788581943.425282:0:6688:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788581943.425292:0:6688:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d0d97e999b8) 00000020:00000080:3.0:1788581943.425304:0:6688:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788581943.426434:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788581943.430307:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788581943.430317:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788581943.431079:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788581943.431086:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788581943.431486:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788581943.431492:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788581943.444072:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788581943.444297:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1788581943.444303:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788581943.448090:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788581943.448114:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788581943.492081:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788581943.493142:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788581943.493149:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788581943.495337:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788581943.495354:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788581943.497134:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788581943.497147:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788581943.502725:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788581943.502930:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788581943.502936:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788581943.503945:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788581943.503955:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788581943.573638:0:6688:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788581943.573851:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788581943.573857:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788581943.579468:0:6688:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788581943.579496:0:6688:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1788581943.584339:0:6688:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1788581943.584368:0:6688:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1788581943.584375:0:6688:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.112@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1788581943.619130:0:6688:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.112@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788581943.619179:0:6688:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.112@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1788581943.619184:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788581943.619185:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788581943.619187:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581943.619188:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581943.619189:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581943.619191:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581943.619192:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788581943.619198:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788581943.619199:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788581943.619414:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581943.619415:0:6688:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788581943.619419:0:6688:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1788581943.619421:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788581943.619422:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788581943.619423:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581943.619424:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581943.619425:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581943.619426:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581943.619426:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788581943.619427:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788581943.619428:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788581943.619429:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581943.619430:0:6688:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788581943.619547:0:6688:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788581943.619568:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020824960:0@lo:253: 00000100:00100000:2.0:1788581943.619659:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581943.619751:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d9dd5e300 going to sleep for 11 seconds 00000100:00100000:1.0:1788581943.619819:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020824960 00000100:00100000:1.0:1788581943.619827:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020824960 00000100:00100000:1.0:1788581943.619913:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788581943.619923:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:6688:x1875464020824960:12345-0@lo:253: 20000000:01000000:1.0:1788581943.619963:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788581943.619967:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1788581943.619972:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1788581943.619976:0:5837:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1788581943.622544:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581943.622998:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788581943.623023:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1788581943.623068:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1788581943.623076:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1788581943.623123:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1788581943.623185:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1788581943.625175:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1788581943.626464:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.112@tcp 20000000:01000000:2.0:1788581943.626469:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.112@tcp (null) (null) (null) 00000040:00080000:2.0:1788581943.626556:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1788581943.626580:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788581943.626667:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1788581943.626685:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.112@tcp (null) (null) 00000040:00080000:2.0:1788581943.626722:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1788581943.626732:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788581943.626764:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1788581943.626821:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1788581943.627835:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1788581943.627852:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.112@tcp 20000000:01000000:2.0:1788581943.627855:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.112@tcp (null) (null) (null) 00000040:00080000:2.0:1788581943.627899:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1788581943.627906:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788581943.627934:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1788581943.627942:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.112@tcp (null) (null) 00000040:00080000:2.0:1788581943.627987:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1788581943.627996:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788581943.628027:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1788581943.628061:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1788581943.628077:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1788581943.628080:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1788581943.628087:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788581943.628088:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788581943.628090:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788581943.628104:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788581943.628106:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788581943.628140:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788581943.628143:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788581943.630314:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1788581943.630519:0:6703:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1788581943.630591:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1788581943.631008:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1788581943.631051:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1788581943.631122:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1788581943.631137:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788581943.631140:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788581943.633550:0:6704:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1788581943.633632:0:6704:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1788581943.633672:0:6704:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788581943.634747:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1788581943.634915:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1788581943.634966:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1788581943.634979:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788581943.634981:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788581943.635469:0:6705:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1788581943.635693:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1788581943.635723:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1788581943.635772:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 10000000:01000000:2.0:1788581943.635790:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1788581943.635813:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d0d8138e400/0x2bc3aa892c3a699a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.635833:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d80030000/0x2bc3aa892c3a68b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a68ac expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.635841:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d8167c600/0x2bc3aa892c3a68cf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a68c8 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.635848:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d80030200/0x2bc3aa892c3a693f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6938 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.635855:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d0d8138e400/0x2bc3aa892c3a699a lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.635896:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d80030200/0x2bc3aa892c3a693f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a6938 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.635911:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d80030200/0x2bc3aa892c3a693f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6938 expref: 12 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581943.635925:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7720380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1875464020825088:0@lo:104: 00000100:00100000:2.0:1788581943.635993:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581943.636077:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d8167c600/0x2bc3aa892c3a68cf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a68c8 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.636095:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d8167c600/0x2bc3aa892c3a68cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a68c8 expref: 12 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581943.636104:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7720a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1875464020825216:0@lo:104: 00000100:00100000:2.0:1788581943.636124:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581943.636189:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d80030000/0x2bc3aa892c3a68b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a68ac expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.636197:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d80030000/0x2bc3aa892c3a68b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a68ac expref: 12 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581943.636229:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7723b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1875464020825344:0@lo:104: 00000100:00100000:2.0:1788581943.636247:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581943.636313:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020825088 00000100:00100000:0.0:1788581943.636320:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020825088 00000100:00100000:0.0:1788581943.636351:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020825216 00000100:00100000:0.0:1788581943.636363:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020825216 00000100:00100000:0.0:1788581943.636376:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788581943.636384:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7722300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+4:5837:x1875464020825088:12345-0@lo:104: 00010000:00010000:0.0:1788581943.636395:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d8152f800/0x2bc3aa892c3a6938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a693f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.636439:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581943.636444:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7722300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+4:5837:x1875464020825088:12345-0@lo:104: Request processed in 61us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581943.636450:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788581943.636464:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788581943.636469:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7721880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:5837:x1875464020825216:12345-0@lo:104: 00010000:00010000:0.0:1788581943.636482:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a68c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a68cf expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.636510:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788581943.636515:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7721880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:5837:x1875464020825216:12345-0@lo:104: Request processed in 46us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581943.636520:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1788581943.636535:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788581943.636540:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d8152f800/0x2bc3aa892c3a6938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a693f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.636547:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8152f800 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:0.0:1788581943.636551:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8152f800/0x2bc3aa892c3a6938 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a693f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.636560:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d8152f800/0x2bc3aa892c3a6938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a693f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581943.636568:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8152f800/0x2bc3aa892c3a6938 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a693f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581943.636585:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788581943.636613:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d8152f800/0x2bc3aa892c3a6938 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a693f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.636619:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581943.636634:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d8152f800/0x2bc3aa892c3a6938 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a693f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.636640:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d8152f800/0x2bc3aa892c3a6938 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a693f expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.636660:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581943.636664:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a68c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a68cf expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.636669:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8167ca00 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:0.0:1788581943.636672:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a68c8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a68cf expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.636678:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a68c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a68cf expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581943.636683:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a68c8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a68cf expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581943.636687:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788581943.636700:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a68c8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a68cf expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.636717:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581943.636732:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a68c8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a68cf expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.636740:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a68c8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a68cf expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.636750:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581943.636752:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581943.636754:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581943.636773:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020825472:0@lo:103: 00000100:00100000:0.0:1788581943.636804:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581943.636845:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020825600:0@lo:103: 00000100:00100000:0.0:1788581943.636880:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581943.636916:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020825472 00000100:00100000:0.0:1788581943.636921:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020825472 00010000:00010000:0.0:1788581943.636937:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d80030200/0x2bc3aa892c3a693f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6938 expref: 13 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581943.636956:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020825600 00000100:00100000:0.0:1788581943.636958:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020825600 00010000:00010000:0.0:1788581943.636968:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d8167c600/0x2bc3aa892c3a68cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a68c8 expref: 14 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581943.636980:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788581943.636985:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:3309:x1875464020825472:12345-0@lo:103: 00010000:00010000:0.0:1788581943.636995:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581943.637000:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d80030200/0x2bc3aa892c3a693f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6938 expref: 14 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.637011:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d80030200/0x2bc3aa892c3a693f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6938 expref: 14 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.637025:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581943.637052:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:3309:x1875464020825472:12345-0@lo:103: Request processed in 66us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581943.637059:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788581943.637070:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788581943.637076:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:3306:x1875464020825600:12345-0@lo:103: 00010000:00010000:0.0:1788581943.637082:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581943.637091:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d8167c600/0x2bc3aa892c3a68cf lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a68c8 expref: 13 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.637100:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d8167c600/0x2bc3aa892c3a68cf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a68c8 expref: 13 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.637108:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581943.637134:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:3306:x1875464020825600:12345-0@lo:103: Request processed in 58us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581943.637140:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788581943.637179:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020825600:0@lo:103: 00000100:00100000:0.0:1788581943.637230:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020825472:0@lo:103: 00010000:00010000:3.0:1788581943.638920:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581943.639043:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8d8840 going to sleep for 11 seconds 00010000:00010000:2.0:1788581943.639075:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d80030200/0x2bc3aa892c3a693f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a6938 expref: 12 pid: 5836 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581943.639093:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7720380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1875464020825088:0@lo:104: 00010000:00010000:2.0:1788581943.639104:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8167c600/0x2bc3aa892c3a68cf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a68c8 expref: 11 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581943.639113:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7720a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1875464020825216:0@lo:104: 00000100:00100000:3.0:1788581943.639326:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020825344 00000100:00100000:3.0:1788581943.639335:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020825344 00000100:00100000:3.0:1788581943.639395:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788581943.639404:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7720700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:5837:x1875464020825344:12345-0@lo:104: 00010000:00010000:3.0:1788581943.639419:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a68ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a68b3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.639485:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788581943.639491:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7720700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:5837:x1875464020825344:12345-0@lo:104: Request processed in 89us (3243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581943.639498:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788581943.639788:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7723b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1875464020825344:0@lo:104: 00010000:00010000:2.0:1788581943.639814:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d0d8138e400/0x2bc3aa892c3a699a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.639961:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581943.639967:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a68ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a68b3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.639975:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8138fa00 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:0.0:1788581943.639979:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a68ac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a68b3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.639987:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a68ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a68b3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581943.639994:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a68ac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a68b3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581943.640000:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788581943.640046:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a68ac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a68b3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.640071:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581943.640091:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a68ac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a68b3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.640098:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a68ac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a68b3 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.640114:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581943.640116:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581943.640117:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581943.640126:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788581943.640139:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020825728:0@lo:103: 00000100:00100000:0.0:1788581943.640179:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581943.640237:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020825728 00000100:00100000:0.0:1788581943.640242:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020825728 00010000:00010000:0.0:1788581943.640263:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d80030000/0x2bc3aa892c3a68b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a68ac expref: 11 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581943.640283:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788581943.640290:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:3306:x1875464020825728:12345-0@lo:103: 00010000:00010000:0.0:1788581943.640300:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581943.640306:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d80030000/0x2bc3aa892c3a68b3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a68ac expref: 11 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.640315:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d80030000/0x2bc3aa892c3a68b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a68ac expref: 11 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.640328:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d80030000/0x2bc3aa892c3a68b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a68ac expref: 11 pid: 5837 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.640538:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d0d8138e400/0x2bc3aa892c3a699a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.640549:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8138e400/0x2bc3aa892c3a699a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.640565:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0d8138e400/0x2bc3aa892c3a699a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.640581:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0d8138e400/0x2bc3aa892c3a699a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.640587:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d0d8138e400/0x2bc3aa892c3a699a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.640593:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d0d8138e400/0x2bc3aa892c3a699a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.640597:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8138e400 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:0.0:1788581943.640601:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d0d8138e400/0x2bc3aa892c3a699a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.640608:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d0d8138e400/0x2bc3aa892c3a699a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.640771:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d0d8138e400/0x2bc3aa892c3a699a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.640785:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d0d8138e400/0x2bc3aa892c3a699a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788581943.640794:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:0.0:1788581943.643078:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d0d8138e400/0x2bc3aa892c3a699a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.643097:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8138e400/0x2bc3aa892c3a699a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.643135:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581943.643321:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+10:3306:x1875464020825728:12345-0@lo:103: Request processed in 3027us (3137us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581943.643331:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788581943.643668:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020825728:0@lo:103: 00000100:00100000:1.0:1788581943.700882:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+9:6688:x1875464020824960:12345-0@lo:253: Request processed in 80953us (81214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581943.700897:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788581943.701007:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020824960:0@lo:253: 10000000:01000000:2.0:1788581943.701023:0:6688:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788581943.701027:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788581943.701029:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788581943.701030:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788581943.701031:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788581943.701032:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788581943.701033:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788581943.701034:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788581943.701036:0:6688:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788581943.701037:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788581943.701039:0:6688:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788581943.701058:0:6688:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d0dac39a800 from lustre-OST0000 10000000:01000000:2.0:1788581943.701086:0:6688:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788581943.701088:0:6688:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788581943.701096:0:6688:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d0d9dde8000 local copy 10000000:01000000:2.0:1788581943.701100:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788581943.701142:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f600/0x2bc3aa892c3a69a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.701153:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f600/0x2bc3aa892c3a69a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.701162:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f600/0x2bc3aa892c3a69a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581943.701197:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020825856:0@lo:101: 00000100:00100000:2.0:1788581943.701251:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581943.701298:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8d8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788581943.701400:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020825856 00000100:00100000:1.0:1788581943.701474:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020825856 00000100:00100000:1.0:1788581943.701517:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788581943.701526:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+9:6688:x1875464020825856:12345-0@lo:101: 00010000:00010000:1.0:1788581943.701538:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581943.701550:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8167d600/0x2bc3aa892c3a69a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a69a1 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581943.701587:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8167d600/0x2bc3aa892c3a69a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a69a1 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581943.701598:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8167d600/0x2bc3aa892c3a69a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a69a1 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581943.701606:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8167d600, rc 0) 00000100:00100000:1.0:1788581943.701646:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+10:6688:x1875464020825856:12345-0@lo:101: Request processed in 122us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581943.701653:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788581943.701838:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020825856:0@lo:101: 00010000:00010000:2.0:1788581943.701850:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f600/0x2bc3aa892c3a69a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2bc3aa892c3a69a8 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.701860:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f600/0x2bc3aa892c3a69a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2bc3aa892c3a69a8 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581943.701970:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020825984:0@lo:501: 00000100:00100000:2.0:1788581943.701994:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581943.702014:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8d8780 going to sleep for 11 seconds 00000100:00100000:1.0:1788581943.702109:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020825984 00000100:00100000:1.0:1788581943.702114:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020825984 00000100:00100000:1.0:1788581943.702143:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788581943.702149:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+10:6688:x1875464020825984:12345-0@lo:501: 00000100:00100000:1.0:1788581943.702363:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+10:6688:x1875464020825984:12345-0@lo:501: Request processed in 213us (367us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788581943.702371:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788581943.702548:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020825984:0@lo:501: 10000000:01000000:2.0:1788581943.702559:0:6688:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788581943.702678:0:6688:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788581943.702684:0:6688:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f600/0x2bc3aa892c3a69a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2bc3aa892c3a69a8 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.702692:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f600/0x2bc3aa892c3a69a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2bc3aa892c3a69a8 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.702699:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f600/0x2bc3aa892c3a69a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2bc3aa892c3a69a8 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.702723:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788581943.702753:0:6688:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d0dac39a800 10000000:01000000:2.0:1788581943.702758:0:6688:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788581943.702763:0:6688:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d0d9dde8000 10000000:01000000:2.0:1788581943.702766:0:6688:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788581943.702769:0:6688:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d0d9dde8000 from 1 10000000:01000000:2.0:1788581943.702772:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788581943.702793:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138e400/0x2bc3aa892c3a69af lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.702800:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d8138e400/0x2bc3aa892c3a69af lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.702808:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d8138e400/0x2bc3aa892c3a69af lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581943.702822:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020826112:0@lo:101: 00000100:00100000:2.0:1788581943.702849:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581943.702919:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8d89c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788581943.702976:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581943.702982:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f600/0x2bc3aa892c3a69a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2bc3aa892c3a69a8 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581943.702989:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8138f600 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:1.0:1788581943.702993:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f600/0x2bc3aa892c3a69a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x2bc3aa892c3a69a8 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581943.703001:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f600/0x2bc3aa892c3a69a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x2bc3aa892c3a69a8 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581943.703008:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f600/0x2bc3aa892c3a69a1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x2bc3aa892c3a69a8 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581943.703014:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581943.703033:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f600/0x2bc3aa892c3a69a1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2bc3aa892c3a69a8 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581943.703039:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581943.703065:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f600/0x2bc3aa892c3a69a1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2bc3aa892c3a69a8 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581943.703079:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f600/0x2bc3aa892c3a69a1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x2bc3aa892c3a69a8 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581943.703094:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581943.703096:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581943.703098:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581943.703106:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581943.703118:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020826240:0@lo:103: 00000100:00100000:1.0:1788581943.703159:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581943.703186:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020826240 00000100:00100000:1.0:1788581943.703191:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020826240 00000100:00100000:1.0:1788581943.703253:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581943.703261:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+10:3309:x1875464020826240:12345-0@lo:103: 00010000:00010000:1.0:1788581943.703271:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581943.703283:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8167d600/0x2bc3aa892c3a69a8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bc3aa892c3a69a1 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581943.703297:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581943.703325:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+9:3309:x1875464020826240:12345-0@lo:103: Request processed in 66us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581943.703332:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581943.703368:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020826240:0@lo:103: 00000100:00100000:0.0:1788581943.703696:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020826112 00000100:00100000:0.0:1788581943.703701:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020826112 00000100:00100000:0.0:1788581943.703767:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788581943.703775:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+9:6688:x1875464020826112:12345-0@lo:101: 00010000:00010000:0.0:1788581943.703785:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581943.703799:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d80030000/0x2bc3aa892c3a69b6 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a69af expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.703815:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d80030000/0x2bc3aa892c3a69b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a69af expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.703824:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d80030000/0x2bc3aa892c3a69b6 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a69af expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.703831:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d80030000, rc 0) 00000100:00100000:0.0:1788581943.703872:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+10:6688:x1875464020826112:12345-0@lo:101: Request processed in 97us (1022us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581943.703877:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788581943.703936:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020826112:0@lo:101: 00010000:00010000:2.0:1788581943.703948:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d8138e400/0x2bc3aa892c3a69af lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a69b6 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.703965:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d8138e400/0x2bc3aa892c3a69af lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a69b6 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581943.703982:0:6688:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788581943.703998:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138e400/0x2bc3aa892c3a69af lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a69b6 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.704005:0:6688:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d8138e400/0x2bc3aa892c3a69af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a69b6 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581943.704020:0:6688:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788581943.704024:0:6688:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788581943.704029:0:6688:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788581943.704032:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788581943.704048:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a69bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.704055:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a69bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.704063:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a69bd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581943.704078:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020826368:0@lo:101: 00000100:00100000:2.0:1788581943.704103:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581943.704424:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8d89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581943.704535:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020826368 00000100:00100000:1.0:1788581943.704541:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020826368 00000100:00100000:0.0:1788581943.704643:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788581943.704652:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+10:6688:x1875464020826368:12345-0@lo:101: 00010000:00010000:0.0:1788581943.704660:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581943.704670:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d80030800/0x2bc3aa892c3a69c4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a69bd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.704683:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d80030800/0x2bc3aa892c3a69c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a69bd expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.704704:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d80030800/0x2bc3aa892c3a69c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a69bd expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.704710:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d80030800, rc 0) 00000100:00100000:0.0:1788581943.704752:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:6688:x1875464020826368:12345-0@lo:101: Request processed in 102us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581943.704758:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788581943.704837:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020826368:0@lo:101: 00010000:00010000:2.0:1788581943.704848:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a69bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a69c4 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.704855:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a69bd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a69c4 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581943.704947:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020826496:0@lo:501: 00000100:00100000:2.0:1788581943.705037:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581943.705057:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8d89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581943.705092:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020826496 00000100:00100000:1.0:1788581943.705096:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020826496 00000100:00100000:1.0:1788581943.705114:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788581943.705126:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:6688:x1875464020826496:12345-0@lo:501: 00000100:00100000:1.0:1788581943.705356:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:6688:x1875464020826496:12345-0@lo:501: Request processed in 230us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581943.705363:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788581943.705494:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020826496:0@lo:501: 00000100:00100000:2.0:1788581943.705525:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020826624:0@lo:503: 00000100:00100000:2.0:1788581943.705633:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581943.705662:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8d89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581943.705713:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020826624 00000100:00100000:0.0:1788581943.705717:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020826624 00000100:00100000:0.0:1788581943.705737:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788581943.705743:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:6688:x1875464020826624:12345-0@lo:503: 00000100:00100000:0.0:1788581943.705881:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:6688:x1875464020826624:12345-0@lo:503: Request processed in 138us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581943.705888:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788581943.706033:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020826624:0@lo:503: 00000040:00080000:2.0:1788581943.706329:0:6688:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788581943.706380:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020826752:0@lo:502: 00000100:00100000:2.0:1788581943.706513:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581943.706586:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8d89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581943.706691:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020826752 00000100:00100000:3.0:1788581943.706696:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020826752 00000100:00100000:0.0:1788581943.706769:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788581943.706778:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:6688:x1875464020826752:12345-0@lo:502: 00000100:00100000:0.0:1788581943.706948:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:6688:x1875464020826752:12345-0@lo:502: Request processed in 171us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581943.706955:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788581943.707164:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020826752:0@lo:502: 00000040:00080000:2.0:1788581943.707724:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788581943.707778:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1788581943.707810:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1788581943.707855:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1788581943.707890:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1788581943.707920:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1788581943.707949:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020826880:0@lo:502: 00000100:00100000:2.0:1788581943.708051:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581943.708125:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8d89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581943.708164:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020826880 00000100:00100000:0.0:1788581943.708171:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020826880 00000100:00100000:0.0:1788581943.708280:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788581943.708289:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:6688:x1875464020826880:12345-0@lo:502: 00000100:00100000:0.0:1788581943.708460:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:6688:x1875464020826880:12345-0@lo:502: Request processed in 172us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581943.708467:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788581943.708547:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020826880:0@lo:502: 00000040:00080000:2.0:1788581943.708673:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788581943.708683:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1788581943.709382:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788581943.709390:0:6707:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788581943.709397:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581943.709400:0:6707:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788581943.709417:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788581943.709440:0:6707:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d0dbf4e3370) 00000020:00000080:2.0:1788581943.709471:0:6707:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788581943.709479:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788581943.709549:0:6707:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d0dac39a800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788581943.709557:0:6707:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788581943.709581:0:6707:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2bc3aa892c3a69d2 00010000:00010000:2.0:1788581943.717658:0:6707:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1788581943.717948:0:6707:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1788581943.719843:0:6707:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788581943.720116:0:6707:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1788581943.731442:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788581943.732341:0:6707:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788581943.739493:0:6707:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788581943.739513:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581943.739780:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581943.739783:0:6707:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788581943.739794:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581943.739798:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581943.739800:0:6707:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788581943.739803:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788581943.739805:0:6707:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788581943.739861:0:6707:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581943.739863:0:6707:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581943.739865:0:6707:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788581943.739868:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788581943.739936:0:6688:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1788581943.740053:0:6688:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1788581943.740076:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a69bd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a69c4 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.740088:0:6688:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a69bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a69c4 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581943.740098:0:6688:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0dac39a800 from 1 10000000:01000000:3.0:1788581943.740101:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788581943.740141:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26c00/0x2bc3aa892c3a69d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.740148:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26c00/0x2bc3aa892c3a69d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.740158:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26c00/0x2bc3aa892c3a69d9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581943.740180:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020827008:0@lo:101: 00000100:00100000:3.0:1788581943.740267:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581943.740309:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85adf000 going to sleep for 11 seconds 00000100:00100000:3.0:1788581943.740333:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020827008 00000100:00100000:3.0:1788581943.740346:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020827008 00000100:00100000:3.0:1788581943.740388:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788581943.740397:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:6688:x1875464020827008:12345-0@lo:101: 00010000:00010000:3.0:1788581943.740881:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581943.740897:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d88e26800/0x2bc3aa892c3a69e0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a69d9 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.740920:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d88e26800/0x2bc3aa892c3a69e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a69d9 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.740931:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d88e26800/0x2bc3aa892c3a69e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a69d9 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.740940:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26800, rc 0) 00000100:00100000:3.0:1788581943.741522:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:6688:x1875464020827008:12345-0@lo:101: Request processed in 1124us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581943.741531:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788581943.741768:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a08380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020827008:0@lo:101: 00010000:00010000:2.0:1788581943.741787:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26c00/0x2bc3aa892c3a69d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a69e0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581943.741798:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26c00/0x2bc3aa892c3a69d9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a69e0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581943.741900:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020827136:0@lo:501: 00000100:00100000:2.0:1788581943.741934:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581943.742067:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020827136 00000100:00100000:1.0:1788581943.742074:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020827136 00000100:00100000:1.0:1788581943.742107:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788581943.742116:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:6688:x1875464020827136:12345-0@lo:501: 00000100:00100000:1.0:1788581943.742356:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:6688:x1875464020827136:12345-0@lo:501: Request processed in 242us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581943.742363:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788581943.742555:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8d83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581943.742581:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020827136:0@lo:501: 00000100:00100000:2.0:1788581943.742609:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020827264:0@lo:503: 00000100:00100000:2.0:1788581943.742648:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581943.743044:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8d83c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581943.743149:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020827264 00000100:00100000:3.0:1788581943.743155:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020827264 00000100:00100000:3.0:1788581943.743194:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788581943.743230:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:6688:x1875464020827264:12345-0@lo:503: 00000100:00100000:2.0:1788581943.744504:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:6688:x1875464020827264:12345-0@lo:503: Request processed in 1298us (1850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581943.744515:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788581943.744731:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020827264:0@lo:503: 00000040:00080000:3.0:1788581943.745594:0:6688:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788581943.745814:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a0a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020827392:0@lo:502: 00000100:00100000:3.0:1788581943.745870:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581943.745913:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85adf540 going to sleep for 11 seconds 00000100:00100000:1.0:1788581943.746331:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020827392 00000100:00100000:1.0:1788581943.746340:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020827392 00000100:00100000:1.0:1788581943.746394:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788581943.746517:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:6688:x1875464020827392:12345-0@lo:502: 00000100:00100000:2.0:1788581943.747540:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a0a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020827392:0@lo:502: 00000100:00100000:3.0:1788581943.747775:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:6688:x1875464020827392:12345-0@lo:502: Request processed in 1371us (1903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581943.747795:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000040:00080000:2.0:1788581943.748607:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788581943.749052:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788581943.749106:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7723b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020827520:0@lo:502: 00000100:00100000:2.0:1788581943.749174:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581943.749567:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8d8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581943.749729:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020827520 00000100:00100000:3.0:1788581943.749738:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020827520 00000100:00100000:3.0:1788581943.749790:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788581943.749800:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:6688:x1875464020827520:12345-0@lo:502: 00000100:00100000:3.0:1788581943.750820:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:6688:x1875464020827520:12345-0@lo:502: Request processed in 1017us (1640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581943.750831:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788581943.750936:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7723b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020827520:0@lo:502: 00000040:00080000:2.0:1788581943.751250:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788581943.751263:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788581943.755140:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581943.755155:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581943.755158:0:6711:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788581943.755167:0:6711:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d0dac39a800 00000020:00000080:2.0:1788581943.755169:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788581943.755193:0:6711:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581943.755196:0:6711:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581943.755197:0:6711:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788581943.755389:0:6711:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788581943.755521:0:6688:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788581943.755544:0:6688:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788581943.755567:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26c00/0x2bc3aa892c3a69d9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a69e0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.755590:0:6688:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26c00/0x2bc3aa892c3a69d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a69e0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581943.755633:0:6688:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788581943.755637:0:6688:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d0dac39a800 10000000:01000000:3.0:1788581943.755640:0:6688:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d0dac39a800 10000000:01000000:3.0:1788581943.755643:0:6688:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788581943.755650:0:6688:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0dac39a800 from 1 10000000:01000000:3.0:1788581943.755652:0:6688:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788581943.755702:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a69e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.755712:0:6688:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a69e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.755723:0:6688:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a69e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581943.755760:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a08a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020827648:0@lo:101: 00000100:00100000:3.0:1788581943.755832:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581943.755883:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85adf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581943.756074:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020827648 00000100:00100000:0.0:1788581943.756082:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020827648 00000100:00100000:0.0:1788581943.756130:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788581943.756141:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:6688:x1875464020827648:12345-0@lo:101: 00010000:00010000:0.0:1788581943.756154:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581943.756166:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d80030c00/0x2bc3aa892c3a69ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a69e7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.756189:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d80030c00/0x2bc3aa892c3a69ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a69e7 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.756199:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d80030c00/0x2bc3aa892c3a69ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a69e7 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581943.756233:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d80030c00, rc 0) 00000100:00100000:0.0:1788581943.756275:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:6688:x1875464020827648:12345-0@lo:101: Request processed in 136us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581943.756282:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788581943.756502:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a08a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020827648:0@lo:101: 00010000:00010000:3.0:1788581943.756517:0:6688:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a69e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a69ee expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.756528:0:6688:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a69e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a69ee expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581943.756638:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a08a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020827776:0@lo:501: 00000100:00100000:3.0:1788581943.756676:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581943.756706:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85adf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581943.756752:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020827776 00000100:00100000:2.0:1788581943.756756:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020827776 00000100:00100000:2.0:1788581943.756790:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788581943.756797:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:6688:x1875464020827776:12345-0@lo:501: 00000100:00100000:2.0:1788581943.757098:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:6688:x1875464020827776:12345-0@lo:501: Request processed in 301us (431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581943.757105:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788581943.757193:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a08a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020827776:0@lo:501: 00000100:00100000:3.0:1788581943.757252:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a08a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020827904:0@lo:503: 00000100:00100000:3.0:1788581943.757289:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581943.757310:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85adf6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581943.757388:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020827904 00000100:00100000:2.0:1788581943.757393:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020827904 00000100:00100000:2.0:1788581943.757428:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788581943.757434:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:6688:x1875464020827904:12345-0@lo:503: 00000100:00100000:2.0:1788581943.757593:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:6688:x1875464020827904:12345-0@lo:503: Request processed in 158us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581943.757599:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788581943.757738:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a08a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020827904:0@lo:503: 00000040:00080000:0.0:1788581943.758086:0:6688:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788581943.758152:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020828032:0@lo:502: 00000100:00100000:0.0:1788581943.758196:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581943.758251:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbf75f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581943.758397:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020828032 00000100:00100000:3.0:1788581943.758414:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020828032 00000100:00100000:3.0:1788581943.758454:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788581943.758462:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:6688:x1875464020828032:12345-0@lo:502: 00000100:00100000:3.0:1788581943.758675:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:6688:x1875464020828032:12345-0@lo:502: Request processed in 213us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581943.758683:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788581943.758875:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020828032:0@lo:502: 00000040:00080000:0.0:1788581943.759248:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788581943.759300:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788581943.759335:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788581943.759382:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788581943.759563:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788581943.759627:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788581943.759785:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788581943.759820:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788581943.759862:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788581943.759892:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788581943.759940:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788581943.760138:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788581943.760180:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788581943.760491:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788581943.760539:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788581943.760582:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788581943.760615:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788581943.760734:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788581943.760776:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788581943.760808:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788581943.760867:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788581943.760904:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788581943.760938:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788581943.761056:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788581943.761094:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788581943.761127:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788581943.761190:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788581943.761514:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788581943.761564:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020828160:0@lo:502: 00000100:00100000:0.0:1788581943.761654:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581943.761806:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbf75f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581943.761856:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020828160 00000100:00100000:3.0:1788581943.761871:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020828160 00000100:00100000:3.0:1788581943.761953:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788581943.762031:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:6688:x1875464020828160:12345-0@lo:502: 00000100:00100000:3.0:1788581943.762375:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:6688:x1875464020828160:12345-0@lo:502: Request processed in 347us (721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581943.762383:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788581943.762622:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020828160:0@lo:502: 00000040:00080000:1.0:1788581943.762779:0:6688:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788581943.762790:0:6688:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1788581943.764523:0:6712:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788581943.764555:0:6712:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d0dbf753370) 00000020:00000080:0.0:1788581943.764590:0:6712:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1788581943.764738:0:6712:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d0dac39a800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788581943.764742:0:6712:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d0dac39a800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788581943.764749:0:6712:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0dac39a800 3 00010000:00080000:0.0:1788581943.764778:0:6712:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d0dbf7b1800@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.112@tcp at head 00010000:00010000:0.0:1788581943.768114:0:6712:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1788581943.768489:0:6712:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788581943.768527:0:6712:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788581943.768540:0:6712:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2bc3aa892c3a69fc 00000100:00080000:0.0:1788581943.768550:0:6712:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788581943.768557:0:6712:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d0dbf7b1800 using connection 192.168.201.112@tcp/0@lo 00000100:00100000:0.0:1788581943.768620:0:6712:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0da702d500 x1875464020828288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788581943.768686:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875464020828288:0@lo:38: 00000100:00100000:2.0:1788581943.768762:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788581943.769021:0:6712:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788581943.769093:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875464020828416:0@lo:400: 00000100:00100000:0.0:1788581943.769123:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581943.769161:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020828288 00000100:00100000:0.0:1788581943.769168:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020828288 00000100:00100000:0.0:1788581943.769192:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020828416 00000100:00100000:0.0:1788581943.769195:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020828416 00000100:00100000:0.0:1788581943.769241:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788581943.769250:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875464020828416:12345-0@lo:400: 00000100:00100000:0.0:1788581943.769300:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875464020828416:12345-0@lo:400: Request processed in 51us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581943.769307:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788581943.769321:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788581943.769325:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875464020828288:12345-0@lo:38: 00010000:00080000:0.0:1788581943.769346:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 162 last 0 00000020:00000080:0.0:1788581943.769386:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2bc3aa892c3a6a03 00000004:00100000:0.0:1788581943.769466:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788581943.769502:0:5843:0:(import.c:65:import_set_state_nolock()) ffff8d0dbf7b4000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788581943.769822:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875464020828288:12345-0@lo:38: Request processed in 493us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581943.769829:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788581943.769863:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d0da702dc00 x1875464020828416/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581943.769876:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875464020828416:0@lo:400: 00000040:00080000:0.0:1788581943.770588:0:6712:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:2.0:1788581943.770817:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d0da702d500 x1875464020828288/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581943.770828:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788581943.770835:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788581943.770843:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788581943.770847:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788581943.770850:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0dbf7b1800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788581943.770856:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875464020828288:0@lo:38: 00000020:01000000:3.0:1788581943.771293:0:6688:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1788581943.771323:0:6688:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788581943.771346:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a69e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a69ee expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.771357:0:6688:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a69e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a69ee expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788581943.771516:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788581943.771519:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788581943.771521:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581943.771522:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581943.771523:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581943.771524:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581943.771526:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788581943.771528:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788581943.771530:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788581943.771531:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581943.771533:0:6688:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788581943.771536:0:6688:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1788581943.771538:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788581943.771540:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788581943.771541:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581943.771542:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581943.771543:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581943.771544:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581943.771545:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788581943.771546:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788581943.771548:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788581943.771555:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581943.771556:0:6688:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788581943.771586:0:6688:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788581943.771601:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020828544:0@lo:253: 00000100:00100000:3.0:1788581943.771655:0:6688:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581943.772795:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85adfb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788581943.777269:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020828544 00000100:00100000:0.0:1788581943.777283:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020828544 00000100:00100000:0.0:1788581943.777341:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788581943.777350:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:6688:x1875464020828544:12345-0@lo:253: 20000000:01000000:0.0:1788581943.777392:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788581943.777620:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788581943.807526:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788581943.807544:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788581943.807614:0:5859:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788581943.807620:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788581943.807644:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6a0a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.807664:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d80031400/0x2bc3aa892c3a6969 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6962 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.807673:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6a0a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.807717:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d80031400/0x2bc3aa892c3a6969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a6962 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.807731:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d80031400/0x2bc3aa892c3a6969 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6962 expref: 13 pid: 5838 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581943.807746:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a0bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1875464020828672:0@lo:104: 00000100:00100000:3.0:1788581943.807818:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581943.807874:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85adff00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581943.807896:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020828672 00000100:00100000:3.0:1788581943.807903:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020828672 00000100:00100000:3.0:1788581943.808670:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788581943.808682:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:5859:x1875464020828672:12345-0@lo:104: 00010000:00010000:3.0:1788581943.808698:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d8152fc00/0x2bc3aa892c3a6962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6969 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.808774:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788581943.808780:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:5859:x1875464020828672:12345-0@lo:104: Request processed in 102us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581943.808787:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788581943.808828:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a0bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1875464020828672:0@lo:104: 00010000:00010000:3.0:1788581943.808847:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6a0a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581943.809513:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581943.809520:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d8152fc00/0x2bc3aa892c3a6962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6969 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581943.809528:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8152fc00 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:1.0:1788581943.809532:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8152fc00/0x2bc3aa892c3a6962 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a6969 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581943.809540:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d8152fc00/0x2bc3aa892c3a6962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a6969 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581943.809554:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8152fc00/0x2bc3aa892c3a6962 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a6969 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581943.809560:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788581943.809608:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d8152fc00/0x2bc3aa892c3a6962 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6969 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581943.809614:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581943.809631:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d8152fc00/0x2bc3aa892c3a6962 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6969 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581943.809637:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d8152fc00/0x2bc3aa892c3a6962 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6969 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581943.809655:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581943.809666:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581943.809668:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581943.809684:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020828800:0@lo:103: 00000100:00100000:1.0:1788581943.809725:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581943.809771:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020828800 00000100:00100000:3.0:1788581943.809778:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020828800 00010000:00010000:3.0:1788581943.809804:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d80031400/0x2bc3aa892c3a6969 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6962 expref: 14 pid: 5838 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581943.809835:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788581943.809843:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d86671c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:3306:x1875464020828800:12345-0@lo:103: 00010000:00010000:3.0:1788581943.809855:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581943.809861:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d80031400/0x2bc3aa892c3a6969 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6962 expref: 14 pid: 5838 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.809872:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d80031400/0x2bc3aa892c3a6969 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6962 expref: 14 pid: 5838 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.809885:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d80031400/0x2bc3aa892c3a6969 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a6962 expref: 14 pid: 5838 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.809899:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6a0a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.811613:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6a0a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788581943.811639:0:5829:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004020305s 00010000:00010000:3.0:1788581943.811645:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6a0a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.811652:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6a0a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.811659:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6a0a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.811666:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6a0a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.811671:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26200 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:3.0:1788581943.811675:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6a0a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.811682:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6a0a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.811699:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6a0a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.811710:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581943.811790:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d86671c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:3306:x1875464020828800:12345-0@lo:103: Request processed in 1945us (2060us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581943.811800:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788581943.811800:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020828800:0@lo:103: 00010000:00010000:3.0:1788581943.811876:0:5859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6a0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.811884:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6a0a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581943.811889:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6a0a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581943.824036:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:6688:x1875464020828544:12345-0@lo:253: Request processed in 46676us (52369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581943.824053:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788581943.824164:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a09880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6688:1875464020828544:0@lo:253: 10000000:01000000:3.0:1788581943.824183:0:6688:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788581943.824187:0:6688:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788581943.824189:0:6688:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788581943.824190:0:6688:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581943.824191:0:6688:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581943.824193:0:6688:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581943.824194:0:6688:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581943.824195:0:6688:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788581943.824197:0:6688:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788581943.824199:0:6688:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788581943.824220:0:6688:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581943.824222:0:6688:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788581943.824242:0:6688:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788581943.834398:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788581943.835288:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788581943.835497:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788581943.837152:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788581943.838105:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788581943.838734:0:6688:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788581943.841163:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:2.0:1788581944.045658:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788581944.106758:0:6688:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788581944.106782:0:6688:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788581944.106820:0:6688:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788581944.106880:0:6688:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.112@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788581944.106896:0:6688:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788581944.106922:0:6688:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788581945.070014:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581946.100842:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581947.124238:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581948.141327:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581948.910343:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020828928:0@lo:400: 00000100:00100000:0.0:1788581948.910411:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581948.910469:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020829056:0@lo:400: 00000100:00100000:0.0:1788581948.910509:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581948.910530:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581948.910535:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020829184:0@lo:400: 00000100:00100000:0.0:1788581948.910558:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581948.910601:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020829056 00000100:00100000:0.0:1788581948.910608:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020829056 00000100:00100000:0.0:1788581948.910655:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020829184 00000100:00100000:0.0:1788581948.910659:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020829184 00000100:00100000:0.0:1788581948.910688:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788581948.910695:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020829056:12345-0@lo:400: 00000100:00100000:0.0:1788581948.910742:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020829056:12345-0@lo:400: Request processed in 48us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581948.910749:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788581948.910765:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788581948.910770:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020829184:12345-0@lo:400: 00000100:00100000:0.0:1788581948.910795:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020829184:12345-0@lo:400: Request processed in 24us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581948.910800:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788581948.910839:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0da702f480 x1875464020829184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581948.910852:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020829184:0@lo:400: 00010000:00080000:0.0:1788581948.910863:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0da702e680 x1875464020829056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581964 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581948.910870:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020829056:0@lo:400: 00000100:00100000:0.0:1788581948.912898:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020828928 00000100:00100000:0.0:1788581948.912909:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020828928 00000100:00100000:0.0:1788581948.912961:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788581948.912970:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:3307:x1875464020828928:12345-0@lo:400: 00000100:00100000:0.0:1788581948.913041:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:3307:x1875464020828928:12345-0@lo:400: Request processed in 72us (2629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581948.913048:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788581948.913093:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020828928:0@lo:400: 00000100:00080000:2.0:1788581948.915292:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:3.0:1788581948.916057:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788581948.916062:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0d945e5800 from 21 10000000:01000000:3.0:1788581948.916068:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788581948.916115:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26200/0x2bc3aa892c3a6a11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581948.916127:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26200/0x2bc3aa892c3a6a11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581948.916150:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26200/0x2bc3aa892c3a6a11 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581948.916172:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a09880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020829312:0@lo:101: 00000100:00100000:3.0:1788581948.917019:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581948.917117:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da786bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581948.920035:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020829312 00000100:00100000:0.0:1788581948.920050:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020829312 00000100:00100000:0.0:1788581948.920159:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788581948.920170:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:5840:x1875464020829312:12345-0@lo:101: 00010000:00010000:0.0:1788581948.920188:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581948.920231:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d80031800/0x2bc3aa892c3a6a18 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6a11 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581948.920259:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d80031800/0x2bc3aa892c3a6a18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6a11 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581948.920271:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d80031800/0x2bc3aa892c3a6a18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6a11 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581948.920281:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d80031800, rc 0) 00000100:00100000:0.0:1788581948.920362:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:5840:x1875464020829312:12345-0@lo:101: Request processed in 193us (3494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581948.920368:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788581948.920459:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a09880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020829312:0@lo:101: 00010000:00010000:2.0:1788581948.920477:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26200/0x2bc3aa892c3a6a11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6a18 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581948.920513:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26200/0x2bc3aa892c3a6a11 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6a18 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581948.921665:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7720a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020829440:0@lo:501: 00000100:00100000:2.0:1788581948.921715:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581948.927729:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c82b946c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581948.929681:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020829440 00000100:00100000:3.0:1788581948.929696:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020829440 00000100:00100000:3.0:1788581948.929752:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788581948.929762:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:5840:x1875464020829440:12345-0@lo:501: 00000100:00100000:3.0:1788581948.930064:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:5840:x1875464020829440:12345-0@lo:501: Request processed in 303us (8348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581948.930072:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788581948.932903:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7720a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020829440:0@lo:501: 00000100:00100000:3.0:1788581948.932968:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020829568:0@lo:503: 00000100:00100000:3.0:1788581948.933038:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581948.933123:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da786bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581948.934737:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020829568 00000100:00100000:2.0:1788581948.934750:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020829568 00000100:00100000:0.0:1788581948.937647:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788581948.937668:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:5840:x1875464020829568:12345-0@lo:503: 00000100:00100000:0.0:1788581948.937905:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:5840:x1875464020829568:12345-0@lo:503: Request processed in 245us (4866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581948.937914:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788581948.937999:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a0a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020829568:0@lo:503: 00000100:00100000:0.0:1788581948.938249:0:6990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6990:1875464020829696:0@lo:502: 00000100:00100000:0.0:1788581948.938288:0:6990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581948.938313:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020829696 00000100:00100000:0.0:1788581948.938325:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020829696 00000100:00100000:0.0:1788581948.938356:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788581948.938362:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:6990:x1875464020829696:12345-0@lo:502: 00000100:00100000:0.0:1788581948.940412:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:6990:x1875464020829696:12345-0@lo:502: Request processed in 2043us (2116us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581948.940424:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788581948.940776:0:6990:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbf75f180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581948.940801:0:6990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6990:1875464020829696:0@lo:502: 00000100:00100000:0.0:1788581948.940862:0:6990:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6990:1875464020829824:0@lo:502: 00000100:00100000:0.0:1788581948.940904:0:6990:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581948.940922:0:6990:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbf75f180 going to sleep for 11 seconds 00000100:00100000:2.0:1788581948.945799:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020829824 00000100:00100000:2.0:1788581948.945815:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020829824 00000100:00100000:2.0:1788581948.945871:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788581948.945881:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:6990:x1875464020829824:12345-0@lo:502: 00000100:00100000:2.0:1788581948.946140:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:6990:x1875464020829824:12345-0@lo:502: Request processed in 260us (5235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581948.946148:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788581948.946445:0:6990:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6990:1875464020829824:0@lo:502: 00000040:00080000:0.0:1788581948.946508:0:6990:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:2.0:1788581948.946787:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:2.0:1788581948.946809:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788581948.946819:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26200/0x2bc3aa892c3a6a11 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6a18 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581948.946830:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26200/0x2bc3aa892c3a6a11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6a18 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581948.946840:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788581948.946843:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d0d945e5800 from 4 10000000:01000000:2.0:1788581948.946846:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788581948.946878:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f000/0x2bc3aa892c3a6a1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581948.946900:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f000/0x2bc3aa892c3a6a1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581948.946910:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f000/0x2bc3aa892c3a6a1f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581948.946929:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7720380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020829952:0@lo:101: 00000100:00100000:2.0:1788581948.946966:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581948.947007:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c82b94f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788581948.947057:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020829952 00000100:00100000:0.0:1788581948.947062:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020829952 00000100:00100000:0.0:1788581948.947098:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788581948.947106:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:5840:x1875464020829952:12345-0@lo:101: 00010000:00010000:0.0:1788581948.947116:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581948.947131:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d80031600/0x2bc3aa892c3a6a26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6a1f expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581948.947152:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d80031600/0x2bc3aa892c3a6a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6a1f expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581948.947162:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d80031600/0x2bc3aa892c3a6a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6a1f expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581948.947171:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d80031600, rc 0) 00000100:00100000:0.0:1788581948.947241:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:5840:x1875464020829952:12345-0@lo:101: Request processed in 135us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581948.947248:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788581948.947345:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7720380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020829952:0@lo:101: 00010000:00010000:2.0:1788581948.947358:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f000/0x2bc3aa892c3a6a1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6a26 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581948.947366:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f000/0x2bc3aa892c3a6a1f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6a26 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581948.947406:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7720380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020830080:0@lo:256: 00000100:00100000:2.0:1788581948.947432:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581948.947466:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c82b94f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581948.947478:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020830080 00000100:00100000:2.0:1788581948.947492:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020830080 00000100:00100000:2.0:1788581948.947519:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788581948.947525:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:5840:x1875464020830080:12345-0@lo:256: 20000000:01000000:2.0:1788581948.947538:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788581948.947553:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788581948.947556:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1788581948.947634:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:5840:x1875464020830080:12345-0@lo:256: Request processed in 108us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581948.947645:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788581948.947675:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7720380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020830080:0@lo:256: 10000000:01000000:2.0:1788581948.947710:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788581948.947716:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f000/0x2bc3aa892c3a6a1f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6a26 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581948.947722:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f000/0x2bc3aa892c3a6a1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6a26 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581948.947729:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788581948.947731:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:2.0:1788581948.947733:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788581948.947745:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6a2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581948.947750:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6a2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581948.947757:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6a2d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581948.947766:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7720380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020830208:0@lo:101: 00000100:00100000:2.0:1788581948.947788:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581948.947801:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c82b94f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581948.947811:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020830208 00000100:00100000:2.0:1788581948.947814:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020830208 00000100:00100000:2.0:1788581948.947830:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788581948.947836:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:5840:x1875464020830208:12345-0@lo:101: 00010000:00010000:2.0:1788581948.947851:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581948.947861:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8138e600/0x2bc3aa892c3a6a34 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6a2d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581948.947874:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8138e600/0x2bc3aa892c3a6a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6a2d expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581948.947882:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8138e600/0x2bc3aa892c3a6a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6a2d expref: 15 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581948.947888:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8138e600, rc 0) 00000100:00100000:2.0:1788581948.947914:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:5840:x1875464020830208:12345-0@lo:101: Request processed in 78us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581948.947920:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788581948.947946:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7720380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020830208:0@lo:101: 00010000:00010000:2.0:1788581948.947955:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6a2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6a34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581948.947963:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6a2d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6a34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581948.948004:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7720380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020830336:0@lo:501: 00000100:00100000:2.0:1788581948.948027:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581948.948039:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c82b94f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581948.948050:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020830336 00000100:00100000:2.0:1788581948.948053:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020830336 00000100:00100000:2.0:1788581948.948070:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788581948.948076:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:5840:x1875464020830336:12345-0@lo:501: 00000100:00100000:2.0:1788581948.948331:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:5840:x1875464020830336:12345-0@lo:501: Request processed in 255us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581948.948338:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788581948.948362:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7720380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020830336:0@lo:501: 00000100:00100000:2.0:1788581948.948386:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7720380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020830464:0@lo:503: 00000100:00100000:2.0:1788581948.948418:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581948.948430:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c82b94f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581948.948438:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020830464 00000100:00100000:2.0:1788581948.948441:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020830464 00000100:00100000:2.0:1788581948.948455:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788581948.948461:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:5840:x1875464020830464:12345-0@lo:503: 00000100:00100000:2.0:1788581948.948643:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:5840:x1875464020830464:12345-0@lo:503: Request processed in 181us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581948.948650:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788581948.948685:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7720380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020830464:0@lo:503: 00000100:00100000:2.0:1788581948.948846:0:6991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7720380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6991:1875464020830592:0@lo:502: 00000100:00100000:2.0:1788581948.948878:0:6991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581948.948894:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020830592 00000100:00100000:2.0:1788581948.948898:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020830592 00000100:00100000:2.0:1788581948.948917:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788581948.948924:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:6991:x1875464020830592:12345-0@lo:502: 00000100:00100000:2.0:1788581948.949086:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:6991:x1875464020830592:12345-0@lo:502: Request processed in 162us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581948.949093:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788581948.949119:0:6991:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c82b94000 going to sleep for 11 seconds 00000100:00100000:2.0:1788581948.949136:0:6991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7720380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6991:1875464020830592:0@lo:502: 00000020:01000000:2.0:1788581948.949155:0:6991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788581948.949162:0:6991:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788581948.949169:0:6991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581948.949172:0:6991:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788581948.949177:0:6991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788581948.949180:0:6991:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.112@tcp to nid 0x20000c0a8c970 (192.168.201.112@tcp) 00000020:01000000:2.0:1788581948.949230:0:6991:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788581948.949233:0:6991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788581948.949248:0:6991:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d0dbf4e0000) 00000020:00000080:2.0:1788581948.949266:0:6991:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1788581948.949272:0:6991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788581948.949352:0:6991:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788581948.949357:0:6991:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788581948.949364:0:6991:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bc3aa892c3a6a42 00010000:00080000:2.0:1788581948.949392:0:6991:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d0c8302d000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.112@tcp at head 00010000:00010000:2.0:1788581948.949656:0:6991:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788581948.981884:0:6991:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788581948.981909:0:6991:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788581948.984092:0:6991:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788581948.984287:0:6991:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788581948.984328:0:6991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788581948.984367:0:6991:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1788581948.986034:0:6994:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788581948.986040:0:6994:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788581948.987651:0:6991:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788581948.987666:0:6991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788581948.987714:0:6991:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788581948.987737:0:6991:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bc3aa892c3a6a49 00000100:00080000:3.0:1788581948.987753:0:6991:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788581948.987759:0:6991:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d0c8302d000 using connection 192.168.201.112@tcp/0@lo 00000100:00100000:3.0:1788581948.987795:0:6991:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0d91a0bb80 x1875464020830720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788581948.987825:0:6991:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788581948.987899:0:6991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581948.987903:0:6991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581948.987906:0:6991:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788581948.987909:0:6991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581948.987912:0:6991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581948.987914:0:6991:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788581948.987917:0:6991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788581948.987919:0:6991:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788581948.987949:0:6991:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6991:1875464020830848:0@lo:502: 00000100:00100000:2.0:1788581948.987974:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020830720:0@lo:8: 00000100:00100000:2.0:1788581948.989293:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581948.989398:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020830720 00000100:00100000:2.0:1788581948.989406:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020830720 00000100:00100000:2.0:1788581948.989531:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788581948.989542:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1875464020830720:12345-0@lo:8: 00010000:00080000:2.0:1788581948.989640:0:6691:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 167 last 0 00000020:00000080:2.0:1788581948.989673:0:6691:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bc3aa892c3a6a50 00002000:00100000:2.0:1788581948.989712:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d0c8302e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788581948.989728:0:6691:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1788581948.989732:0:6691:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788581948.990003:0:6691:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788581948.991726:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788581948.991779:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8d0c83028800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788581948.991887:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7720380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1875464020830720:12345-0@lo:8: Request processed in 2341us (2595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581948.991900:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788581948.992141:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0d91a0bb80 x1875464020830720/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788581958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581948.992175:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788581948.992185:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788581948.992193:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788581948.992199:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788581948.992234:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0c8302d000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788581948.992248:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788581948.992256:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020830720:0@lo:8: 00000004:00080000:1.0:1788581948.992289:0:6994:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1788581948.992438:0:6994:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 167986235462ns, next at 0ns, rc = 0 00000100:00100000:3.0:1788581948.994929:0:6991:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581948.995692:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020830848 00000100:00100000:2.0:1788581948.995703:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020830848 00000100:00100000:2.0:1788581948.995771:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788581948.995782:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:6991:x1875464020830848:12345-0@lo:502: 00000100:00100000:2.0:1788581948.996062:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:6991:x1875464020830848:12345-0@lo:502: Request processed in 281us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581948.996071:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788581948.996855:0:6991:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85adf3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581948.996884:0:6991:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a0b800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:6991:1875464020830848:0@lo:502: 00000020:01000000:2.0:1788581948.996920:0:6991:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581948.996928:0:6991:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581948.996931:0:6991:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788581948.996936:0:6991:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788581948.996997:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788581948.997012:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788581948.997022:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6a2d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6a34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581948.997033:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6a2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6a34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581948.997043:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788581948.997046:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d0d9dde8000 from 1 10000000:01000000:2.0:1788581948.997055:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788581948.997084:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ee00/0x2bc3aa892c3a6a57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581948.997092:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ee00/0x2bc3aa892c3a6a57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581948.997101:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ee00/0x2bc3aa892c3a6a57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581948.997118:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7723800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020830976:0@lo:101: 00000100:00100000:2.0:1788581948.997160:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581948.997181:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c82b946c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581949.000459:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020830976 00000100:00100000:0.0:1788581949.000663:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020830976 00000100:00100000:0.0:1788581949.001304:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788581949.001316:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:5840:x1875464020830976:12345-0@lo:101: 00010000:00010000:0.0:1788581949.001334:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581949.001353:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d80030e00/0x2bc3aa892c3a6a5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6a57 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581949.001380:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d80030e00/0x2bc3aa892c3a6a5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6a57 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581949.001391:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d80030e00/0x2bc3aa892c3a6a5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6a57 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581949.001401:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d80030e00, rc 0) 00000100:00100000:3.0:1788581949.001593:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7723800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020830976:0@lo:101: 00010000:00010000:3.0:1788581949.001612:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ee00/0x2bc3aa892c3a6a57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6a5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581949.001621:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ee00/0x2bc3aa892c3a6a57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6a5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581949.001775:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020831104:0@lo:501: 00000100:00100000:3.0:1788581949.002018:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581949.002057:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85adf540 going to sleep for 11 seconds 00000100:00100000:0.0:1788581949.002154:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:5840:x1875464020830976:12345-0@lo:101: Request processed in 161us (4313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581949.002161:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788581949.002379:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020831104 00000100:00100000:0.0:1788581949.002385:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020831104 00000100:00100000:0.0:1788581949.002408:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788581949.002415:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:5840:x1875464020831104:12345-0@lo:501: 00000100:00100000:0.0:1788581949.003356:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:5840:x1875464020831104:12345-0@lo:501: Request processed in 938us (1335us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788581949.003366:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788581949.003560:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a08e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020831104:0@lo:501: 10000000:01000000:2.0:1788581949.003854:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788581949.003865:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ee00/0x2bc3aa892c3a6a57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6a5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581949.003881:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ee00/0x2bc3aa892c3a6a57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6a5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788581949.031477:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:2.0:1788581949.060963:0:6995:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788581949.060994:0:6995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7722a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6995:1875464020831360:0@lo:7: 00000100:00100000:2.0:1788581949.061056:0:6995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581949.061105:0:6995:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d97efdf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788581949.061135:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020831232:0@lo:13: 00000100:00100000:2.0:1788581949.061159:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581949.061194:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020831360 00000100:00100000:2.0:1788581949.061225:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020831360 00000100:00100000:2.0:1788581949.061269:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581949.061277:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7721f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6995:x1875464020831360:12345-0@lo:7: 00000100:00080000:3.0:1788581949.063899:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581949.064004:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020831232 00000100:00100000:0.0:1788581949.064020:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020831232 00000100:00100000:0.0:1788581949.064080:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788581949.064091:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875464020831232:12345-0@lo:13: 00002000:00000024:0.0:1788581949.064123:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788581949.064229:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1875464020831232:12345-0@lo:13: Request processed in 140us (3068us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581949.064237:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788581949.066699:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0db7720e00 x1875464020831232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581965 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581949.066726:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7720e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020831232:0@lo:13: 00002000:00080000:2.0:1788581949.069700:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788581949.069709:0:6693:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788581949.069878:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7721f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6995:x1875464020831360:12345-0@lo:7: Request processed in 8586us (8806us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581949.069889:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788581949.070329:0:6995:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0db7722a00 x1875464020831360/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788581965 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581949.070354:0:6995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7722a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6995:1875464020831360:0@lo:7: 00000004:00080000:3.0:1788581949.070368:0:6995:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788581949.070489:0:6995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7720e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6995:1875464020831488:0@lo:5: 00000100:00100000:2.0:1788581949.070536:0:6995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581949.070579:0:6995:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d97efd540 going to sleep for 11 seconds 00000100:00100000:3.0:1788581949.070641:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020831488 00000100:00100000:3.0:1788581949.070648:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020831488 00000100:00100000:3.0:1788581949.070694:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788581949.070703:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7720a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6995:x1875464020831488:12345-0@lo:5: 00002000:00080000:3.0:1788581949.070729:0:6692:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788581949.070733:0:6692:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788581949.070997:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7720a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6995:x1875464020831488:12345-0@lo:5: Request processed in 293us (460us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788581949.071004:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788581949.071144:0:6995:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0db7720e00 x1875464020831488/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788581965 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581949.071156:0:6995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7720e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6995:1875464020831488:0@lo:5: 00000004:00080000:2.0:1788581949.071165:0:6995:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788581949.071191:0:6995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6995:1875464020831616:0@lo:700: 00000100:00100000:2.0:1788581949.071234:0:6995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581949.071261:0:6995:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d97efd540 going to sleep for 11 seconds 00000100:00100000:3.0:1788581949.071400:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020831616 00000100:00100000:3.0:1788581949.071405:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020831616 00000100:00100000:3.0:1788581949.071440:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788581949.071447:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7722680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6995:x1875464020831616:12345-0@lo:700: 00000100:00100000:3.0:1788581949.071475:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6699:1875464020831744:0@lo:700: 00000100:00100000:3.0:1788581949.071514:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581949.071538:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8d8000 going to sleep for 11 seconds 00000100:00100000:2.0:1788581949.071595:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020831744 00000100:00100000:2.0:1788581949.071599:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020831744 00000100:00100000:2.0:1788581949.071632:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788581949.071638:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6699:x1875464020831744:12345-0@lo:700: 40000000:02000000:2.0:1788581949.155131:0:5850:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1788581949.159984:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6699:x1875464020831744:12345-0@lo:700: Request processed in 88336us (88458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581949.159999:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788581949.160131:0:6699:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0d91a0aa00 x1875464020831744/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788581965 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581949.160148:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a0aa00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6699:1875464020831744:0@lo:700: 40000000:02000000:1.0:1788581949.160164:0:6699:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:0.0:1788581949.167536:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788581949.283843:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788581949.283859:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1788581949.284025:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7722680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+6:6995:x1875464020831616:12345-0@lo:700: Request processed in 212573us (212785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581949.284039:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788581949.284096:0:6995:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0db7723480 x1875464020831616/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788581965 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581949.284108:0:6995:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1788581949.284125:0:6995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6995:1875464020831616:0@lo:700: 00000004:02000040:3.0:1788581949.347982:0:6995:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1788581949.356009:0:6995:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a09180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6995:1875464020831872:0@lo:5: 00000100:00100000:3.0:1788581949.356086:0:6995:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581949.356129:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020831872 00000100:00100000:3.0:1788581949.356138:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020831872 00000100:00100000:3.0:1788581949.356195:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788581949.356230:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6995:x1875464020831872:12345-0@lo:5: 00000100:00100000:0.0:1788581949.364075:0:6995:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da792f780 going to sleep for 11 seconds 00002000:00080000:3.0:1788581949.365854:0:6693:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788581949.366296:0:6693:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1788581949.369310:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6995:x1875464020831872:12345-0@lo:5: Request processed in 13072us (13215us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788581949.369323:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788581949.369638:0:6995:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0d91a09180 x1875464020831872/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788581965 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581949.369659:0:6995:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a09180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6995:1875464020831872:0@lo:5: 00000004:00080000:1.0:1788581949.369673:0:6995:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000001:02000400:2.0:1788581950.042247:0:7061:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg112-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788581950.190110:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581951.213472:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581952.237365:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581953.261421:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581954.029966:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020832384:0@lo:400: 00000100:00100000:3.0:1788581954.030035:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581954.030105:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581954.030112:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020832000:0@lo:400: 00000100:00100000:3.0:1788581954.030141:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581954.030238:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020832384 00000100:00100000:1.0:1788581954.030246:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020832384 00000100:00100000:1.0:1788581954.030296:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581954.030306:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875464020832384:12345-0@lo:400: 00000100:00100000:1.0:1788581954.030360:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a08000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1875464020832384:12345-0@lo:400: Request processed in 55us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581954.030382:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788581954.030432:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0dac38dc00 x1875464020832384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581954.030447:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020832384:0@lo:400: 00000100:00100000:0.0:1788581954.030517:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020832128:0@lo:400: 00000100:00100000:0.0:1788581954.030549:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581954.030577:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581954.030582:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020832256:0@lo:400: 00000100:00100000:0.0:1788581954.030603:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581954.030637:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020832128 00000100:00100000:0.0:1788581954.030641:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020832128 00000100:00100000:0.0:1788581954.030664:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020832256 00000100:00100000:0.0:1788581954.030667:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020832256 00000100:00100000:0.0:1788581954.030681:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788581954.030687:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020832128:12345-0@lo:400: 00000100:00100000:0.0:1788581954.030720:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020832128:12345-0@lo:400: Request processed in 32us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581954.030726:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788581954.030739:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788581954.030745:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020832256:12345-0@lo:400: 00000100:00100000:0.0:1788581954.030770:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020832256:12345-0@lo:400: Request processed in 25us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581954.030894:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788581954.030926:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0dac38d500 x1875464020832256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581954.030937:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020832256:0@lo:400: 00010000:00080000:0.0:1788581954.030947:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0dac38c000 x1875464020832128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581970 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581954.030955:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020832128:0@lo:400: 00000100:00080000:3.0:1788581954.031013:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788581954.031018:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581954.031074:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020832000 00000100:00100000:2.0:1788581954.031079:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020832000 00000100:00100000:2.0:1788581954.031116:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788581954.031123:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:3306:x1875464020832000:12345-0@lo:400: 00000100:00100000:2.0:1788581954.031169:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:3306:x1875464020832000:12345-0@lo:400: Request processed in 46us (1027us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581954.031175:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788581954.031278:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020832000:0@lo:400: 00010000:00010000:1.0:1788581954.289271:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581954.542492:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581954.542519:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020832512:0@lo:13: 00000100:00100000:3.0:1788581954.542590:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581954.543048:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020832512 00000100:00100000:2.0:1788581954.543057:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020832512 00000100:00100000:2.0:1788581954.543109:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788581954.543118:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875464020832512:12345-0@lo:13: 00002000:00000024:2.0:1788581954.543147:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581954.543196:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a0aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875464020832512:12345-0@lo:13: Request processed in 78us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581954.543223:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788581954.572005:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0db7720000 x1875464020832512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581970 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581954.572035:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7720000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020832512:0@lo:13: 00000001:00080000:1.0:1788581954.644567:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1788581955.309646:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581956.333364:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581957.368163:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581958.386926:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581959.150705:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020832896:0@lo:400: 00000100:00100000:3.0:1788581959.150789:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581959.150844:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581959.150850:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020833024:0@lo:400: 00000100:00100000:3.0:1788581959.150875:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581959.150915:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020832896 00000100:00100000:3.0:1788581959.150922:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020832896 00000100:00100000:3.0:1788581959.150981:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581959.150992:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020832896:12345-0@lo:400: 00000100:00100000:3.0:1788581959.151044:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020832896:12345-0@lo:400: Request processed in 54us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581959.151052:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581959.151074:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020833024 00000100:00100000:3.0:1788581959.151078:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020833024 00000100:00100000:3.0:1788581959.151103:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788581959.151110:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020833024:12345-0@lo:400: 00000100:00100000:3.0:1788581959.151139:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a08a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020833024:12345-0@lo:400: Request processed in 30us (263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581959.151145:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1788581959.151160:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581959.151164:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788581959.151193:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0d91a0a680 x1875464020833024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581959.151229:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788581959.151243:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020833024:0@lo:400: 00010000:00080000:3.0:1788581959.151255:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0d91a0bb80 x1875464020832896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581959.151264:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a0bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020832896:0@lo:400: 00000100:00100000:2.0:1788581959.151400:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875464020832768:0@lo:400: 00000100:00100000:2.0:1788581959.151432:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581959.151460:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788581959.151476:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020832640:0@lo:400: 00000100:00100000:2.0:1788581959.151514:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581959.151656:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020832640 00000100:00100000:0.0:1788581959.151661:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020832640 00000100:00100000:0.0:1788581959.151703:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788581959.151710:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:3309:x1875464020832640:12345-0@lo:400: 00000100:00100000:0.0:1788581959.151749:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:3309:x1875464020832640:12345-0@lo:400: Request processed in 39us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581959.151755:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788581959.151790:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a08e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020832640:0@lo:400: 00000100:00100000:3.0:1788581959.151924:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020832768 00000100:00100000:3.0:1788581959.151928:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020832768 00000100:00100000:3.0:1788581959.151960:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581959.151968:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875464020832768:12345-0@lo:400: 00000100:00100000:3.0:1788581959.152008:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875464020832768:12345-0@lo:400: Request processed in 41us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581959.152013:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1788581959.152101:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0d91a0b800 x1875464020832768/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581975 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581959.152111:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a0b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875464020832768:0@lo:400: 00010000:00010000:0.0:1788581959.405665:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581959.664290:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020833152:0@lo:13: 00000100:00100000:2.0:1788581959.664379:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581959.664462:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020833152 00000100:00100000:2.0:1788581959.664469:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020833152 00000100:00100000:2.0:1788581959.664520:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788581959.664530:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020833152:12345-0@lo:13: 00002000:00000024:2.0:1788581959.664562:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581959.664606:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7720000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020833152:12345-0@lo:13: Request processed in 77us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581959.664613:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788581959.664654:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0db7721180 x1875464020833152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581975 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581959.664673:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020833152:0@lo:13: 00000020:01000004:2.0:1788581959.680546:0:7630:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788581959.680550:0:7630:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788581959.680846:0:7630:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d0dbf4ee800 00000020:01000004:2.0:1788581959.680863:0:7630:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1788581959.680876:0:7630:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788581959.680890:0:7630:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d0dbf4e19b8) 00000020:00000080:2.0:1788581959.680906:0:7630:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788581959.697436:0:7630:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788581959.697695:0:7630:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1788581959.715531:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788581959.718973:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788581959.719006:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788581959.719043:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788581959.719058:0:7630:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788581959.719350:0:7630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1788581959.719361:0:7630:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788581959.719374:0:7630:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2bc3aa892c3a6a6c 00000020:01000004:2.0:1788581959.719381:0:7630:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1788581959.719403:0:7630:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.112@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788581959.719406:0:7630:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788581959.719413:0:7630:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1788581959.719435:0:7630:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1788581959.719440:0:7630:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.112@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788581959.730990:0:7630:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.112@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788581959.731028:0:7630:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.112@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1788581959.731033:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788581959.731035:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788581959.731036:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581959.731038:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581959.731039:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581959.731040:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581959.731042:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788581959.731044:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788581959.731045:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788581959.731047:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581959.731048:0:7630:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788581959.731052:0:7630:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1788581959.731055:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788581959.731056:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788581959.731057:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788581959.731059:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788581959.731060:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788581959.731061:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788581959.731062:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788581959.731063:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788581959.731064:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788581959.731065:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788581959.731070:0:7630:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788581959.731104:0:7630:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788581959.731123:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020833280:0@lo:253: 00000100:00100000:3.0:1788581959.731289:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581959.731407:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da337f900 going to sleep for 11 seconds 00000100:00100000:0.0:1788581959.731466:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020833280 00000100:00100000:0.0:1788581959.731474:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020833280 00000100:00100000:0.0:1788581959.731579:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788581959.731589:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:7630:x1875464020833280:12345-0@lo:253: 20000000:01000000:0.0:1788581959.731628:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788581959.731642:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788581959.731647:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788581959.731650:0:5837:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1788581959.732636:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788581959.732846:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1788581959.732861:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1788581959.732901:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1788581959.732909:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1788581959.732941:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1788581959.732991:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1788581959.733411:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1788581959.733431:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.112@tcp 20000000:01000000:0.0:1788581959.733432:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.112@tcp (null) (null) (null) 00000040:00080000:0.0:1788581959.733465:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1788581959.733472:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788581959.733519:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1788581959.733528:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.112@tcp (null) (null) 00000040:00080000:0.0:1788581959.733563:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1788581959.733572:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788581959.733603:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1788581959.733652:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:0.0:1788581959.734390:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:0.0:1788581959.734406:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.201.112@tcp 20000000:01000000:0.0:1788581959.734408:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.201.112@tcp (null) (null) (null) 00000040:00080000:0.0:1788581959.734442:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:0.0:1788581959.734450:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788581959.734482:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:0.0:1788581959.734490:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.112@tcp (null) (null) 00000040:00080000:0.0:1788581959.734521:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:0.0:1788581959.734530:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1788581959.734583:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:0.0:1788581959.734619:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:0.0:1788581959.734634:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1788581959.734637:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1788581959.734643:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788581959.734645:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788581959.734647:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788581959.734658:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788581959.734661:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788581959.734692:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1788581959.734695:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1788581959.735890:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1788581959.736453:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1788581959.736496:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1788581959.736562:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1788581959.736577:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788581959.736579:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788581959.737246:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1788581959.737311:0:7633:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1788581959.737368:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1788581959.737660:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1788581959.737827:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1788581959.737905:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1788581959.737915:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788581959.737917:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788581959.738360:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1788581959.738406:0:7634:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1788581959.738459:0:7634:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1788581959.738648:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1788581959.738671:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1788581959.738792:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1788581959.738805:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788581959.738807:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788581959.739498:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1788581959.739563:0:7635:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1788581959.739583:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1788581959.739932:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1788581959.739972:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1788581959.740028:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:3.0:1788581959.740048:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788581959.740070:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a6a73 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.740088:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d80030800/0x2bc3aa892c3a69c4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a69bd expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.740094:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d80030c00/0x2bc3aa892c3a69ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a69e7 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.740100:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d80031800/0x2bc3aa892c3a6a18 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6a11 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.740106:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d8138e600/0x2bc3aa892c3a6a34 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6a2d expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.740112:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d80030e00/0x2bc3aa892c3a6a5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6a57 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.740118:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a6a73 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.740377:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d80030e00/0x2bc3aa892c3a6a5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a6a57 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.740407:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d80030e00/0x2bc3aa892c3a6a5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a57 expref: 16 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581959.740422:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a0a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1875464020833408:0@lo:104: 00000100:00100000:3.0:1788581959.740489:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788581959.740580:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d8138e600/0x2bc3aa892c3a6a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a6a2d expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.740590:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d8138e600/0x2bc3aa892c3a6a34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a2d expref: 16 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581959.740598:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a09180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1875464020833536:0@lo:104: 00010000:00010000:3.0:1788581959.740637:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d80031800/0x2bc3aa892c3a6a18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a6a11 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.740645:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d80031800/0x2bc3aa892c3a6a18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a11 expref: 16 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581959.740653:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a0a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1875464020833664:0@lo:104: 00010000:00010000:3.0:1788581959.740696:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d80030c00/0x2bc3aa892c3a69ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a69e7 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.740704:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d80030c00/0x2bc3aa892c3a69ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a69e7 expref: 16 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581959.740711:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a08380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1875464020833792:0@lo:104: 00010000:00010000:3.0:1788581959.740735:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d80030800/0x2bc3aa892c3a69c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a69bd expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.740755:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d80030800/0x2bc3aa892c3a69c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a69bd expref: 16 pid: 5838 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581959.740764:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a0b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1875464020833920:0@lo:104: 00000100:00100000:3.0:1788581959.740784:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da337fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788581959.740949:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788581959.740967:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581959.741032:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581959.741085:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581959.741103:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020833408 00000100:00100000:3.0:1788581959.741110:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020833408 00000100:00100000:3.0:1788581959.741379:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020833536 00000100:00100000:3.0:1788581959.741383:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020833536 00000100:00100000:3.0:1788581959.741398:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020833664 00000100:00100000:3.0:1788581959.741401:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020833664 00000100:00100000:3.0:1788581959.741414:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788581959.741422:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da71d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+5:5837:x1875464020833408:12345-0@lo:104: 00010000:00010000:3.0:1788581959.741434:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ee00/0x2bc3aa892c3a6a57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6a5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.741499:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788581959.741506:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da71d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+5:5837:x1875464020833408:12345-0@lo:104: Request processed in 85us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581959.741512:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788581959.741552:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581959.741559:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+4:5837:x1875464020833536:12345-0@lo:104: 00010000:00010000:3.0:1788581959.741567:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6a2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6a34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.741598:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788581959.741605:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+4:5837:x1875464020833536:12345-0@lo:104: Request processed in 46us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581959.741618:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581959.741629:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581959.741635:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:5837:x1875464020833664:12345-0@lo:104: 00010000:00010000:3.0:1788581959.741643:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26200/0x2bc3aa892c3a6a11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6a18 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.741671:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788581959.741783:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a0a680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1875464020833408:0@lo:104: 00000100:00100000:2.0:1788581959.741793:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a09180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1875464020833536:0@lo:104: 00000100:00100000:2.0:1788581959.741799:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a0a300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1875464020833664:0@lo:104: 00000100:00100000:3.0:1788581959.741838:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:5837:x1875464020833664:12345-0@lo:104: Request processed in 202us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581959.741845:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1788581959.741862:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788581959.741868:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ee00/0x2bc3aa892c3a6a57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6a5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.741875:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8138ee00 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:3.0:1788581959.741879:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ee00/0x2bc3aa892c3a6a57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a6a5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.741888:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ee00/0x2bc3aa892c3a6a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a6a5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581959.741894:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ee00/0x2bc3aa892c3a6a57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a6a5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581959.741900:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788581959.741933:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ee00/0x2bc3aa892c3a6a57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6a5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.741939:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581959.741964:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ee00/0x2bc3aa892c3a6a57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6a5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.741971:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ee00/0x2bc3aa892c3a6a57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6a5e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.741983:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581959.741986:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6a2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6a34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.741992:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8138ea00 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:3.0:1788581959.741995:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6a2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a6a34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.742001:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6a2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a6a34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581959.742007:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6a2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a6a34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581959.742012:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788581959.742025:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6a2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6a34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.742031:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581959.742045:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6a2d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6a34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.742051:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6a2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6a34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.742060:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581959.742069:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26200/0x2bc3aa892c3a6a11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6a18 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.742074:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26200 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:3.0:1788581959.742077:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26200/0x2bc3aa892c3a6a11 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a6a18 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.742084:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26200/0x2bc3aa892c3a6a11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a6a18 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581959.742090:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26200/0x2bc3aa892c3a6a11 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a6a18 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581959.742096:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788581959.742108:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26200/0x2bc3aa892c3a6a11 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6a18 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.742114:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581959.742119:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26200/0x2bc3aa892c3a6a11 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6a18 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.742126:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26200/0x2bc3aa892c3a6a11 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6a18 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.742352:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581959.742356:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581959.742358:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581959.742372:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020834048:0@lo:103: 00000100:00100000:3.0:1788581959.742408:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581959.742454:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020834176:0@lo:103: 00000100:00100000:3.0:1788581959.742486:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581959.742504:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581959.742510:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020834304:0@lo:103: 00000100:00100000:3.0:1788581959.742542:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581959.742576:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020834048 00000100:00100000:3.0:1788581959.742581:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020834048 00010000:00010000:3.0:1788581959.742600:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d80030e00/0x2bc3aa892c3a6a5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a57 expref: 17 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581959.742615:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020834176 00000100:00100000:3.0:1788581959.742617:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020834176 00010000:00010000:3.0:1788581959.742627:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d8138e600/0x2bc3aa892c3a6a34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a2d expref: 18 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581959.742636:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020834304 00000100:00100000:3.0:1788581959.742639:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020834304 00010000:00010000:3.0:1788581959.742649:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d80031800/0x2bc3aa892c3a6a18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a11 expref: 19 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581959.742660:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788581959.742666:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3309:x1875464020834048:12345-0@lo:103: 00000100:00100000:1.0:1788581959.742834:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581959.742844:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020833792 00000100:00100000:1.0:1788581959.742848:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020833792 00000100:00100000:1.0:1788581959.742867:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020833920 00000100:00100000:1.0:1788581959.742869:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020833920 00000100:00100000:1.0:1788581959.742880:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788581959.742886:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+4:5837:x1875464020833792:12345-0@lo:104: 00010000:00010000:1.0:1788581959.742895:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a69e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a69ee expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.742938:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788581959.742943:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+4:5837:x1875464020833792:12345-0@lo:104: Request processed in 58us (1858us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581959.742950:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788581959.742975:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788581959.742981:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:5837:x1875464020833920:12345-0@lo:104: 00010000:00010000:1.0:1788581959.742989:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a69bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a69c4 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.743017:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788581959.743022:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:5837:x1875464020833920:12345-0@lo:104: Request processed in 42us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581959.743028:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581959.743096:0:5830:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788581959.743105:0:5830:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788581959.743153:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a08380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1875464020833792:0@lo:104: 00000100:00100000:2.0:1788581959.743162:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a0b480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5837:1875464020833920:0@lo:104: 00010000:00010000:2.0:1788581959.743187:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a6a73 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.743321:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581959.743328:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d80030e00/0x2bc3aa892c3a6a5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a57 expref: 19 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.743340:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d80030e00/0x2bc3aa892c3a6a5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a57 expref: 19 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.743353:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d80030e00/0x2bc3aa892c3a6a5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a57 expref: 19 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.743378:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581959.743416:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:3309:x1875464020834048:12345-0@lo:103: Request processed in 749us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581959.743422:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788581959.743436:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581959.743446:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:3306:x1875464020834176:12345-0@lo:103: 00010000:00010000:3.0:1788581959.743456:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581959.743459:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d8138e600/0x2bc3aa892c3a6a34 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a2d expref: 17 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.743467:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d8138e600/0x2bc3aa892c3a6a34 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a2d expref: 17 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.743477:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8138e600/0x2bc3aa892c3a6a34 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a2d expref: 17 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.743486:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581959.743512:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:3306:x1875464020834176:12345-0@lo:103: Request processed in 71us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581959.743519:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581959.743531:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581959.743537:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:3306:x1875464020834304:12345-0@lo:103: 00010000:00010000:3.0:1788581959.743544:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581959.743548:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d80031800/0x2bc3aa892c3a6a18 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a11 expref: 15 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.743556:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d80031800/0x2bc3aa892c3a6a18 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a11 expref: 15 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.743572:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d80031800/0x2bc3aa892c3a6a18 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a11 expref: 15 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.743582:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581959.743603:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:3306:x1875464020834304:12345-0@lo:103: Request processed in 67us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581959.743609:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788581959.743638:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020834304:0@lo:103: 00000100:00100000:3.0:1788581959.743646:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a09c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020834176:0@lo:103: 00010000:00010000:3.0:1788581959.743663:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788581959.743667:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a69e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a69ee expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581959.743965:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a08700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020834048:0@lo:103: 00010000:00010000:1.0:1788581959.744253:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581959.744474:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27800 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:3.0:1788581959.744482:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a69e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a69ee expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.744492:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a69e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a69ee expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581959.744499:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a69e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a69ee expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581959.744505:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788581959.744576:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a69e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a69ee expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.744584:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581959.744606:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a69e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a69ee expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.744612:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a69e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a69ee expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.744622:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581959.744624:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581959.744626:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581959.744638:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020834432:0@lo:103: 00000100:00100000:3.0:1788581959.744692:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581959.744741:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020834432 00000100:00100000:3.0:1788581959.744746:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020834432 00010000:00010000:3.0:1788581959.744765:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d80030c00/0x2bc3aa892c3a69ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a69e7 expref: 14 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581959.744788:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788581959.744795:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:3308:x1875464020834432:12345-0@lo:103: 00010000:00010000:3.0:1788581959.744804:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581959.744809:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d80030c00/0x2bc3aa892c3a69ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a69e7 expref: 14 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.744818:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d80030c00/0x2bc3aa892c3a69ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a69e7 expref: 14 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.744829:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d80030c00/0x2bc3aa892c3a69ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a69e7 expref: 14 pid: 5837 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.744840:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788581959.744869:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:3308:x1875464020834432:12345-0@lo:103: Request processed in 75us (194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581959.744881:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788581959.744909:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020834432:0@lo:103: 00010000:00010000:3.0:1788581959.745259:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581959.745262:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581959.745264:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581959.745318:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a69bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a69c4 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.745326:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8138fa00 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:2.0:1788581959.745329:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a69bd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a69c4 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.745337:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a69bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a69c4 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581959.745342:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a69bd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a69c4 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581959.745348:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788581959.745578:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a69bd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a69c4 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.745585:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788581959.745620:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020834560:0@lo:103: 00000100:00100000:3.0:1788581959.745649:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788581959.745820:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a69bd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a69c4 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.745828:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fa00/0x2bc3aa892c3a69bd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a69c4 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.745840:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581959.745842:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581959.745844:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581959.745856:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020834560 00000100:00100000:2.0:1788581959.745868:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020834560 00010000:00010000:2.0:1788581959.745888:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d80030800/0x2bc3aa892c3a69c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a69bd expref: 13 pid: 5838 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581959.745917:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788581959.745925:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:3309:x1875464020834560:12345-0@lo:103: 00010000:00010000:2.0:1788581959.745945:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788581959.745951:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d80030800/0x2bc3aa892c3a69c4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a69bd expref: 13 pid: 5838 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.745960:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d80030800/0x2bc3aa892c3a69c4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a69bd expref: 13 pid: 5838 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.745971:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d80030800/0x2bc3aa892c3a69c4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a69bd expref: 13 pid: 5838 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.745982:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a6a73 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.745990:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a6a73 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.746004:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a6a73 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.746013:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a6a73 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.746019:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a6a73 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.746025:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a6a73 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.746035:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26400 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788581959.746040:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a6a73 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.746047:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a6a73 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.746060:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a6a73 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.746070:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788581959.746387:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:3309:x1875464020834560:12345-0@lo:103: Request processed in 462us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581959.746394:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788581959.746418:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a6a73 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.746425:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a6a73 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.746430:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a6a73 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788581959.746441:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788581959.749837:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020834560:0@lo:103: 00000100:00100000:0.0:1788581959.793423:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:7630:x1875464020833280:12345-0@lo:253: Request processed in 61825us (62124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581959.793437:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788581959.793560:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a0bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020833280:0@lo:253: 10000000:01000000:1.0:1788581959.793576:0:7630:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788581959.793579:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788581959.793581:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788581959.793583:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788581959.793584:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788581959.793585:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788581959.793587:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788581959.793588:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788581959.793590:0:7630:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788581959.793591:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788581959.793593:0:7630:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788581959.793614:0:7630:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d0dbf4ee800 from lustre-OST0001 10000000:01000000:1.0:1788581959.793638:0:7630:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788581959.793642:0:7630:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788581959.793650:0:7630:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d0d9dde8000 local copy 10000000:01000000:1.0:1788581959.793654:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788581959.793705:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d600/0x2bc3aa892c3a6a7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.793716:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d600/0x2bc3aa892c3a6a7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.793744:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d600/0x2bc3aa892c3a6a7a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581959.793764:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020834688:0@lo:101: 00000100:00100000:1.0:1788581959.793801:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581959.793838:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbfb25480 going to sleep for 11 seconds 00000100:00100000:2.0:1788581959.793954:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020834688 00000100:00100000:2.0:1788581959.793962:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020834688 00000100:00100000:2.0:1788581959.794010:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788581959.794019:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+11:7630:x1875464020834688:12345-0@lo:101: 00010000:00010000:2.0:1788581959.794032:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581959.794056:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8138fa00/0x2bc3aa892c3a6a81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6a7a expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.794078:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8138fa00/0x2bc3aa892c3a6a81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6a7a expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.794088:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8138fa00/0x2bc3aa892c3a6a81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6a7a expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.794097:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8138fa00, rc 0) 00000100:00100000:2.0:1788581959.794151:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:7630:x1875464020834688:12345-0@lo:101: Request processed in 133us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581959.794157:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788581959.794350:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020834688:0@lo:101: 00010000:00010000:1.0:1788581959.794362:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d600/0x2bc3aa892c3a6a7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x2bc3aa892c3a6a81 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.794371:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d600/0x2bc3aa892c3a6a7a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2bc3aa892c3a6a81 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581959.794468:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020834816:0@lo:501: 00000100:00100000:1.0:1788581959.794494:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581959.794523:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbfb25480 going to sleep for 11 seconds 00000100:00100000:0.0:1788581959.794578:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020834816 00000100:00100000:0.0:1788581959.794583:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020834816 00000100:00100000:0.0:1788581959.794613:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788581959.794620:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:7630:x1875464020834816:12345-0@lo:501: 00000100:00100000:0.0:1788581959.794831:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:7630:x1875464020834816:12345-0@lo:501: Request processed in 211us (335us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788581959.794839:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788581959.794977:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020834816:0@lo:501: 10000000:01000000:1.0:1788581959.794990:0:7630:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788581959.795019:0:7630:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788581959.795024:0:7630:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d600/0x2bc3aa892c3a6a7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x2bc3aa892c3a6a81 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.795032:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d600/0x2bc3aa892c3a6a7a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2bc3aa892c3a6a81 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.795038:0:7630:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d600/0x2bc3aa892c3a6a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x2bc3aa892c3a6a81 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.795071:0:7630:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788581959.795092:0:7630:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d0dbf4ee800 10000000:01000000:1.0:1788581959.795097:0:7630:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788581959.795102:0:7630:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788581959.795104:0:7630:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788581959.795109:0:7630:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788581959.795111:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788581959.795128:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8167c600/0x2bc3aa892c3a6a88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.795145:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d8167c600/0x2bc3aa892c3a6a88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.795154:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d8167c600/0x2bc3aa892c3a6a88 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581959.795166:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020834944:0@lo:101: 00000100:00100000:1.0:1788581959.795194:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581959.795242:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbfb25e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581959.795374:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020834944 00000100:00100000:2.0:1788581959.795379:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020834944 00000100:00100000:2.0:1788581959.795413:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788581959.795420:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:7630:x1875464020834944:12345-0@lo:101: 00010000:00010000:2.0:1788581959.795429:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581959.795439:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8138f200/0x2bc3aa892c3a6a8f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6a88 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.795455:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8138f200/0x2bc3aa892c3a6a8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6a88 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.795464:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8138f200/0x2bc3aa892c3a6a8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6a88 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.795472:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8138f200, rc 0) 00000100:00100000:2.0:1788581959.795502:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:7630:x1875464020834944:12345-0@lo:101: Request processed in 82us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581959.795517:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00010000:0.0:1788581959.795588:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581959.795595:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d600/0x2bc3aa892c3a6a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2bc3aa892c3a6a81 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581959.795602:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8167d600 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:0.0:1788581959.795606:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d600/0x2bc3aa892c3a6a7a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x2bc3aa892c3a6a81 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581959.795614:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d600/0x2bc3aa892c3a6a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x2bc3aa892c3a6a81 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581959.795621:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d600/0x2bc3aa892c3a6a7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x2bc3aa892c3a6a81 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581959.795627:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788581959.795647:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d600/0x2bc3aa892c3a6a7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2bc3aa892c3a6a81 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581959.795654:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581959.795746:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d600/0x2bc3aa892c3a6a7a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2bc3aa892c3a6a81 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581959.795756:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d600/0x2bc3aa892c3a6a7a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x2bc3aa892c3a6a81 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581959.795769:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581959.795771:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581959.795773:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581959.795781:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581959.795792:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020835072:0@lo:103: 00000100:00100000:0.0:1788581959.795820:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581959.795857:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020835072 00000100:00100000:0.0:1788581959.795860:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020835072 00000100:00100000:0.0:1788581959.795889:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788581959.795896:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:3307:x1875464020835072:12345-0@lo:103: 00010000:00010000:0.0:1788581959.795905:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581959.795916:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8138fa00/0x2bc3aa892c3a6a81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bc3aa892c3a6a7a expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581959.795925:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581959.795954:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:3307:x1875464020835072:12345-0@lo:103: Request processed in 58us (132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581959.795959:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788581959.795993:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020835072:0@lo:103: 00000100:00100000:1.0:1788581959.796100:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020834944:0@lo:101: 00010000:00010000:1.0:1788581959.796113:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d8167c600/0x2bc3aa892c3a6a88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6a8f expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.796121:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d8167c600/0x2bc3aa892c3a6a88 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6a8f expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581959.796308:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020835200:0@lo:501: 00000100:00100000:1.0:1788581959.796345:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581959.796376:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbfb25e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581959.796426:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020835200 00000100:00100000:2.0:1788581959.796431:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020835200 00000100:00100000:2.0:1788581959.796452:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788581959.796459:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:7630:x1875464020835200:12345-0@lo:501: 00000100:00100000:2.0:1788581959.796673:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:7630:x1875464020835200:12345-0@lo:501: Request processed in 214us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581959.796680:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788581959.796880:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020835200:0@lo:501: 00000100:00100000:1.0:1788581959.796908:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020835328:0@lo:503: 00000100:00100000:1.0:1788581959.796945:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581959.796965:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbfb25e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788581959.797055:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020835328 00000100:00100000:0.0:1788581959.797059:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020835328 00000100:00100000:0.0:1788581959.797089:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788581959.797096:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:7630:x1875464020835328:12345-0@lo:503: 00000100:00100000:0.0:1788581959.797382:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:7630:x1875464020835328:12345-0@lo:503: Request processed in 286us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581959.797389:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788581959.797464:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020835328:0@lo:503: 00000040:00080000:1.0:1788581959.797925:0:7630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788581959.797988:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020835456:0@lo:502: 00000100:00100000:1.0:1788581959.798033:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581959.798067:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbfb25e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788581959.798118:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020835456 00000100:00100000:0.0:1788581959.798123:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020835456 00000100:00100000:0.0:1788581959.798314:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788581959.798323:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:7630:x1875464020835456:12345-0@lo:502: 00000100:00100000:0.0:1788581959.798481:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:7630:x1875464020835456:12345-0@lo:502: Request processed in 158us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581959.798488:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788581959.798617:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020835456:0@lo:502: 00000040:00080000:1.0:1788581959.798951:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788581959.798999:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788581959.799035:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788581959.799084:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788581959.799120:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788581959.799347:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788581959.799380:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020835584:0@lo:502: 00000100:00100000:1.0:1788581959.799427:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581959.799496:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbfb25e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788581959.799544:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020835584 00000100:00100000:0.0:1788581959.799551:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020835584 00000100:00100000:0.0:1788581959.799634:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788581959.799643:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:7630:x1875464020835584:12345-0@lo:502: 00000100:00100000:0.0:1788581959.799818:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:7630:x1875464020835584:12345-0@lo:502: Request processed in 176us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581959.799825:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788581959.799902:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020835584:0@lo:502: 00000040:00080000:1.0:1788581959.799991:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788581959.799999:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:1.0:1788581959.800675:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788581959.800695:0:7639:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788581959.800709:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581959.800712:0:7639:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788581959.800718:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788581959.800741:0:7639:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d0dbfb44d28) 00000020:00000080:1.0:1788581959.800765:0:7639:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788581959.800772:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788581959.800845:0:7639:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d0dbf4ee800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788581959.800853:0:7639:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788581959.800860:0:7639:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2bc3aa892c3a6a9d 00010000:00010000:1.0:1788581959.803900:0:7639:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:1.0:1788581959.804237:0:7639:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:1.0:1788581959.808113:0:7639:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1788581959.808524:0:7639:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:1.0:1788581959.812552:0:7639:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:1.0:1788581959.813089:0:7639:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1788581959.814490:0:7639:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788581959.814500:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581959.814505:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581959.814506:0:7639:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788581959.814509:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581959.814512:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581959.814512:0:7639:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788581959.814514:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788581959.814515:0:7639:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788581959.814554:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581959.814555:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581959.814557:0:7639:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788581959.814559:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788581959.815882:0:7630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788581959.815918:0:7630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788581959.819366:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8167c600/0x2bc3aa892c3a6a88 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6a8f expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.819383:0:7630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d8167c600/0x2bc3aa892c3a6a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6a8f expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581959.819391:0:7630:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0dbf4ee800 from 1 10000000:01000000:3.0:1788581959.819395:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788581959.819436:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a6aa4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.819446:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a6aa4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.819457:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a6aa4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581959.819483:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020835712:0@lo:101: 00000100:00100000:3.0:1788581959.819564:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581959.819611:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da337fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581959.819800:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020835712 00000100:00100000:2.0:1788581959.819807:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020835712 00000100:00100000:2.0:1788581959.819857:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788581959.819868:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:7630:x1875464020835712:12345-0@lo:101: 00010000:00010000:2.0:1788581959.819880:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581959.819893:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8138fe00/0x2bc3aa892c3a6aab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6aa4 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.819915:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8138fe00/0x2bc3aa892c3a6aab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6aa4 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.819925:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8138fe00/0x2bc3aa892c3a6aab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6aa4 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.819933:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8138fe00, rc 0) 00000100:00100000:2.0:1788581959.819974:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:7630:x1875464020835712:12345-0@lo:101: Request processed in 108us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581959.819981:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788581959.821396:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020835712:0@lo:101: 00010000:00010000:2.0:1788581959.821440:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a6aa4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6aab expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581959.821452:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a6aa4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6aab expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581959.821576:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020835840:0@lo:501: 00000100:00100000:2.0:1788581959.821622:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581959.821655:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c3b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788581959.821771:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020835840 00000100:00100000:0.0:1788581959.821778:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020835840 00000100:00100000:0.0:1788581959.821823:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788581959.821832:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:7630:x1875464020835840:12345-0@lo:501: 00000100:00100000:0.0:1788581959.822435:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:7630:x1875464020835840:12345-0@lo:501: Request processed in 602us (810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581959.822444:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788581959.823938:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020835840:0@lo:501: 00000100:00100000:3.0:1788581959.824132:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020835968:0@lo:503: 00000100:00100000:3.0:1788581959.824413:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581959.824483:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da337f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788581959.824529:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020835968 00000100:00100000:2.0:1788581959.824535:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020835968 00000100:00100000:2.0:1788581959.824620:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788581959.824629:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:7630:x1875464020835968:12345-0@lo:503: 00000100:00100000:2.0:1788581959.825089:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:7630:x1875464020835968:12345-0@lo:503: Request processed in 459us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581959.825097:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788581959.825188:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020835968:0@lo:503: 00000040:00080000:3.0:1788581959.825489:0:7630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788581959.825571:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020836096:0@lo:502: 00000100:00100000:3.0:1788581959.825609:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581959.826517:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da337f480 going to sleep for 11 seconds 00000100:00100000:0.0:1788581959.826619:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020836096 00000100:00100000:0.0:1788581959.826627:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020836096 00000100:00100000:0.0:1788581959.826669:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788581959.826678:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:7630:x1875464020836096:12345-0@lo:502: 00000100:00100000:0.0:1788581959.826926:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:7630:x1875464020836096:12345-0@lo:502: Request processed in 249us (1315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581959.826935:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788581959.827430:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020836096:0@lo:502: 00000040:00080000:0.0:1788581959.827719:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1788581959.827775:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1788581959.827807:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020836224:0@lo:502: 00000100:00100000:0.0:1788581959.827853:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581959.827874:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85b42300 going to sleep for 11 seconds 00000100:00100000:0.0:1788581959.827897:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020836224 00000100:00100000:0.0:1788581959.827902:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020836224 00000100:00100000:0.0:1788581959.827929:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788581959.827936:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3330850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:7630:x1875464020836224:12345-0@lo:502: 00000100:00100000:0.0:1788581959.828359:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3330850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:7630:x1875464020836224:12345-0@lo:502: Request processed in 422us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581959.828368:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788581959.828464:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020836224:0@lo:502: 00000040:00080000:3.0:1788581959.828571:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788581959.828581:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1788581959.829328:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788581959.829339:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581959.829341:0:7643:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788581959.829346:0:7643:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d0dbf4ee800 00000020:00000080:3.0:1788581959.829349:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788581959.829368:0:7643:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788581959.829371:0:7643:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788581959.829372:0:7643:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788581959.829375:0:7643:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1788581959.829500:0:7630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1788581959.829519:0:7630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788581959.829542:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a6aa4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6aab expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581959.829553:0:7630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a6aa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6aab expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581959.829599:0:7630:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788581959.829602:0:7630:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d0dbf4ee800 10000000:01000000:0.0:1788581959.829605:0:7630:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d0dbf4ee800 10000000:01000000:0.0:1788581959.829610:0:7630:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788581959.829615:0:7630:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0dbf4ee800 from 1 10000000:01000000:0.0:1788581959.829618:0:7630:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788581959.829649:0:7630:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d80031400/0x2bc3aa892c3a6ab2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581959.829657:0:7630:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d80031400/0x2bc3aa892c3a6ab2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581959.829667:0:7630:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d80031400/0x2bc3aa892c3a6ab2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581959.829697:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020836352:0@lo:101: 00000100:00100000:0.0:1788581959.829752:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581959.829785:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85b426c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581959.829802:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020836352 00000100:00100000:0.0:1788581959.829808:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020836352 00000100:00100000:0.0:1788581959.829835:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788581959.829843:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3331850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:7630:x1875464020836352:12345-0@lo:101: 00010000:00010000:0.0:1788581959.829854:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581959.829866:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d80030a00/0x2bc3aa892c3a6ab9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6ab2 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581959.829887:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d80030a00/0x2bc3aa892c3a6ab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6ab2 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581959.829898:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d80030a00/0x2bc3aa892c3a6ab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6ab2 expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581959.829907:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d80030a00, rc 0) 00000100:00100000:0.0:1788581959.829940:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3331850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:7630:x1875464020836352:12345-0@lo:101: Request processed in 97us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581959.829947:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788581959.829984:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020836352:0@lo:101: 00010000:00010000:0.0:1788581959.829996:0:7630:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d80031400/0x2bc3aa892c3a6ab2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6ab9 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581959.830005:0:7630:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d80031400/0x2bc3aa892c3a6ab2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6ab9 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581959.830361:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020836480:0@lo:501: 00000100:00100000:0.0:1788581959.830396:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581959.830411:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85b426c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581959.830424:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020836480 00000100:00100000:0.0:1788581959.830427:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020836480 00000100:00100000:0.0:1788581959.830445:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788581959.830450:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:7630:x1875464020836480:12345-0@lo:501: 00000100:00100000:0.0:1788581959.830644:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:7630:x1875464020836480:12345-0@lo:501: Request processed in 192us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581959.830650:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788581959.830805:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020836480:0@lo:501: 00000100:00100000:0.0:1788581959.830831:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020836608:0@lo:503: 00000100:00100000:0.0:1788581959.830866:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581959.830879:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85b426c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581959.830891:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020836608 00000100:00100000:0.0:1788581959.830894:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020836608 00000100:00100000:0.0:1788581959.830911:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788581959.830916:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:7630:x1875464020836608:12345-0@lo:503: 00000100:00100000:0.0:1788581959.832886:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:7630:x1875464020836608:12345-0@lo:503: Request processed in 1962us (2012us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581959.832899:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788581959.832974:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020836608:0@lo:503: 00000040:00080000:0.0:1788581959.833570:0:7630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788581959.833646:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020836736:0@lo:502: 00000100:00100000:0.0:1788581959.833771:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581959.833804:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85b426c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581959.833826:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020836736 00000100:00100000:0.0:1788581959.833838:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020836736 00000100:00100000:0.0:1788581959.833870:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788581959.833879:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3330c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:7630:x1875464020836736:12345-0@lo:502: 00000100:00100000:0.0:1788581959.834354:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3330c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:7630:x1875464020836736:12345-0@lo:502: Request processed in 475us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581959.834362:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788581959.834412:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020836736:0@lo:502: 00000040:00080000:0.0:1788581959.834658:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788581959.834834:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788581959.834871:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788581959.834920:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788581959.834957:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788581959.835076:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788581959.835118:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788581959.835631:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788581959.835768:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788581959.835809:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788581959.835844:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788581959.835894:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788581959.835925:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788581959.835955:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788581959.836001:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788581959.836375:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788581959.836412:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788581959.836465:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788581959.836502:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788581959.836532:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788581959.836610:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788581959.836635:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788581959.836652:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788581959.836677:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788581959.836787:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788581959.836820:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788581959.836857:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788581959.836876:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1788581959.836892:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788581959.836916:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1788581959.836933:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1788581959.836956:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1788581959.836988:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1788581959.837081:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1788581959.837114:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1788581959.837421:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1788581959.837460:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1788581959.837510:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020836864:0@lo:502: 00000100:00100000:0.0:1788581959.837587:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581959.837638:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85b426c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581959.837763:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020836864 00000100:00100000:1.0:1788581959.837771:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020836864 00000100:00100000:1.0:1788581959.837856:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788581959.837866:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3331050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:7630:x1875464020836864:12345-0@lo:502: 00000100:00100000:1.0:1788581959.838276:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3331050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:7630:x1875464020836864:12345-0@lo:502: Request processed in 411us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581959.838282:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788581959.838442:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020836864:0@lo:502: 00000040:00080000:0.0:1788581959.838502:0:7630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1788581959.838509:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788581959.839093:0:7644:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788581959.839108:0:7644:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d0d97e9cd28) 00000020:00000080:3.0:1788581959.839388:0:7644:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1788581959.839531:0:7644:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d0dbf4ee800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788581959.839536:0:7644:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d0dbf4ee800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788581959.839539:0:7644:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0dbf4ee800 3 00010000:00080000:0.0:1788581959.839573:0:7644:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d0dabc24800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.112@tcp at head 00010000:00010000:0.0:1788581959.841945:0:7644:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1788581959.842266:0:7644:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788581959.842309:0:7644:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788581959.842321:0:7644:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2bc3aa892c3a6ac7 00000100:00080000:0.0:1788581959.842332:0:7644:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788581959.842337:0:7644:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d0dabc24800 using connection 192.168.201.112@tcp/0@lo 00000100:00100000:0.0:1788581959.842370:0:7644:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0da702d880 x1875464020836992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788581959.842401:0:7644:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788581959.842622:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875464020836992:0@lo:38: 00000100:00100000:2.0:1788581959.842702:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581959.842841:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020836992 00000100:00100000:3.0:1788581959.842847:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020836992 00000100:00100000:3.0:1788581959.842878:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788581959.842885:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875464020836992:12345-0@lo:38: 00010000:00080000:3.0:1788581959.842909:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:3.0:1788581959.842932:0:5843:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2bc3aa892c3a6ace 00000004:00100000:3.0:1788581959.842946:0:5843:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788581959.842970:0:5843:0:(import.c:65:import_set_state_nolock()) ffff8d0c8302c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581959.843019:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875464020836992:12345-0@lo:38: Request processed in 134us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581959.843024:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:0.0:1788581959.843240:0:7644:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:0.0:1788581959.843280:0:7630:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788581959.843312:0:7630:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788581959.843328:0:7630:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d80031400/0x2bc3aa892c3a6ab2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6ab9 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581959.843339:0:7630:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d80031400/0x2bc3aa892c3a6ab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6ab9 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788581959.843396:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788581959.843398:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788581959.843400:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581959.843401:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581959.843403:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581959.843404:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581959.843405:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788581959.843407:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788581959.843409:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788581959.843410:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581959.843411:0:7630:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788581959.843414:0:7630:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788581959.843417:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788581959.843418:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788581959.843419:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581959.843420:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581959.843421:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581959.843422:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581959.843423:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788581959.843424:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788581959.843425:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788581959.843426:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581959.843427:0:7630:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788581959.843443:0:7630:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788581959.843454:0:7630:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020837120:0@lo:253: 00000100:00100000:0.0:1788581959.843494:0:7630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581959.843518:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020837120 00000100:00100000:0.0:1788581959.843522:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020837120 00000100:00100000:0.0:1788581959.843552:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788581959.843558:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:7630:x1875464020837120:12345-0@lo:253: 20000000:01000000:0.0:1788581959.843586:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788581959.843599:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00080000:3.0:1788581959.843828:0:7645:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff8d0dabdd1880 x1875464020837248/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581959.843839:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da337f900 going to sleep for 0 seconds 00010000:00080000:2.0:1788581959.843931:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0da702d880 x1875464020836992/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788581969 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581959.843942:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788581959.843950:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788581959.843957:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788581959.843961:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788581959.843964:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0dabc24800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:2.0:1788581959.843978:0:3305:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000002d9588d0): req@ffff8d0dabdd1880 x1875464020837248/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581959.845486:0:7630:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85b42240 going to sleep for 11 seconds 00000100:00100000:3.0:1788581959.846269:0:7645:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581959.846307:0:7645:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da337f900 going to sleep for 11 seconds 00000100:00100000:2.0:1788581959.846365:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875464020836992:0@lo:38: 00000100:00100000:1.0:1788581959.846613:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020837248 00000100:00100000:1.0:1788581959.846621:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020837248 00000100:00100000:1.0:1788581959.846679:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788581959.846688:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7645:x1875464020837248:12345-0@lo:901: 00000100:00100000:1.0:1788581959.847017:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7645:x1875464020837248:12345-0@lo:901: Request processed in 329us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581959.847025:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788581959.847282:0:7645:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0dabdd1880 x1875464020837248/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788581975 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581959.847305:0:7645:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd1880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7645:1875464020837248:0@lo:901: 00000100:00080000:3.0:1788581959.848807:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 20000000:01000000:1.0:1788581959.872785:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788581959.872805:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788581959.874228:0:5859:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788581959.874237:0:5859:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788581959.874261:0:5859:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6ad5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.874280:0:5859:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d80031600/0x2bc3aa892c3a6a26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6a1f expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.874288:0:5859:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6ad5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.874346:0:5859:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d80031600/0x2bc3aa892c3a6a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a6a1f expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.874360:0:5859:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d80031600/0x2bc3aa892c3a6a26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a1f expref: 14 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581959.874396:0:5859:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1875464020837376:0@lo:104: 00000100:00100000:3.0:1788581959.874467:0:5859:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581959.874510:0:5859:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da337f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788581959.874604:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020837376 00000100:00100000:1.0:1788581959.874613:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020837376 00000100:00100000:1.0:1788581959.874661:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581959.874671:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:5859:x1875464020837376:12345-0@lo:104: 00010000:00010000:1.0:1788581959.874695:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f000/0x2bc3aa892c3a6a1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6a26 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.874749:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788581959.874756:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:5859:x1875464020837376:12345-0@lo:104: Request processed in 87us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581959.874763:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581959.874805:0:5859:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd0700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5859:1875464020837376:0@lo:104: 00010000:00010000:1.0:1788581959.874831:0:5859:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6ad5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.874944:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788581959.874950:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f000/0x2bc3aa892c3a6a1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6a26 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.874958:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8138f000 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:3.0:1788581959.874961:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f000/0x2bc3aa892c3a6a1f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a6a26 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.874969:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f000/0x2bc3aa892c3a6a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a6a26 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788581959.874976:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f000/0x2bc3aa892c3a6a1f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a6a26 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581959.874983:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788581959.875019:0:7637:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f000/0x2bc3aa892c3a6a1f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6a26 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.875026:0:7637:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788581959.875047:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f000/0x2bc3aa892c3a6a1f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6a26 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.875054:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f000/0x2bc3aa892c3a6a1f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6a26 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581959.875071:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581959.875078:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581959.875080:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581959.875093:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020837504:0@lo:103: 00000100:00100000:3.0:1788581959.875124:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581959.875232:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020837504 00000100:00100000:1.0:1788581959.875236:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020837504 00010000:00010000:1.0:1788581959.875254:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d80031600/0x2bc3aa892c3a6a26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a1f expref: 15 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581959.875278:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581959.875283:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d86670c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:3307:x1875464020837504:12345-0@lo:103: 00010000:00010000:1.0:1788581959.875293:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581959.875309:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d80031600/0x2bc3aa892c3a6a26 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a1f expref: 15 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.875319:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d80031600/0x2bc3aa892c3a6a26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a1f expref: 15 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.875332:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d80031600/0x2bc3aa892c3a6a26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a1f expref: 15 pid: 5836 timeout: 328 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.875345:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6ad5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.875354:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6ad5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788581959.875366:0:7636:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004020305s 00010000:00010000:1.0:1788581959.875370:0:7636:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6ad5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.875378:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6ad5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.875391:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6ad5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.875398:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6ad5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.875403:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26200 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788581959.875406:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6ad5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.875413:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6ad5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.875426:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6ad5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.875437:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581959.875467:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d86670c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:3307:x1875464020837504:12345-0@lo:103: Request processed in 184us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581959.875474:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788581959.875523:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020837504:0@lo:103: 00010000:00010000:1.0:1788581959.875539:0:5859:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6ad5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.875548:0:5859:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6ad5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581959.875554:0:5859:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d88e26200/0x2bc3aa892c3a6ad5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5859 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581959.880068:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:7630:x1875464020837120:12345-0@lo:253: Request processed in 36499us (36564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581959.880076:0:7630:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:7630:1875464020837120:0@lo:253: 00000100:00100000:3.0:1788581959.880082:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 10000000:01000000:0.0:1788581959.880090:0:7630:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788581959.880093:0:7630:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788581959.880095:0:7630:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788581959.880096:0:7630:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788581959.880097:0:7630:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788581959.880098:0:7630:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788581959.880099:0:7630:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788581959.880101:0:7630:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788581959.880102:0:7630:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788581959.880104:0:7630:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788581959.880105:0:7630:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788581959.880106:0:7630:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788581959.880119:0:7630:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788581959.883621:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788581959.883878:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788581959.884096:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788581959.884427:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788581959.884638:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788581959.884930:0:7630:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788581959.886761:0:7630:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1788581960.035024:0:7630:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1788581960.035031:0:7630:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1788581960.035061:0:7630:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788581960.035129:0:7630:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.112@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788581960.035148:0:7630:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1788581960.035176:0:7630:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788581960.429469:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581961.453828:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581962.478683:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581963.501424:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581964.527893:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581964.783660:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020837632:0@lo:13: 00000100:00100000:3.0:1788581964.783772:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581964.783939:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020837632 00000100:00100000:2.0:1788581964.783950:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020837632 00000100:00100000:2.0:1788581964.784032:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788581964.784045:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020837632:12345-0@lo:13: 00002000:00000024:2.0:1788581964.784094:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581964.784155:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020837632:12345-0@lo:13: Request processed in 112us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581964.784162:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788581964.784254:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0db7722a00 x1875464020837632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581980 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581964.784277:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7722a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020837632:0@lo:13: 00000100:00080000:3.0:1788581964.784422:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581965.295404:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020837760:0@lo:400: 00000100:00100000:3.0:1788581965.295508:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581965.295569:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875464020838272:0@lo:400: 00000100:00100000:3.0:1788581965.295599:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581965.295632:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788581965.295638:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020838144:0@lo:400: 00000100:00100000:3.0:1788581965.295666:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581965.295696:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020837888:0@lo:400: 00000100:00100000:3.0:1788581965.295723:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581965.295744:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581965.295749:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020838016:0@lo:400: 00000100:00100000:3.0:1788581965.295770:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581965.295800:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020838272 00000100:00100000:3.0:1788581965.295808:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020838272 00000100:00100000:3.0:1788581965.295876:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020837888 00000100:00100000:3.0:1788581965.295890:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020837888 00000100:00100000:3.0:1788581965.295904:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020838016 00000100:00100000:3.0:1788581965.295906:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020838016 00000100:00100000:3.0:1788581965.295923:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788581965.295933:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875464020838272:12345-0@lo:400: 00000100:00100000:3.0:1788581965.295993:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875464020838272:12345-0@lo:400: Request processed in 61us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581965.296001:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788581965.296018:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788581965.296024:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020837888:12345-0@lo:400: 00000100:00100000:3.0:1788581965.296050:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020837888:12345-0@lo:400: Request processed in 26us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581965.296056:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788581965.296066:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788581965.296071:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020838016:12345-0@lo:400: 00000100:00100000:3.0:1788581965.296096:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020838016:12345-0@lo:400: Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581965.296101:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788581965.296119:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020838144 00000100:00100000:3.0:1788581965.296123:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020838144 00000100:00100000:3.0:1788581965.296143:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788581965.296149:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020838144:12345-0@lo:400: 00000100:00100000:3.0:1788581965.296174:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020838144:12345-0@lo:400: Request processed in 26us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581965.296180:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788581965.296197:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788581965.296268:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dabdd0000 x1875464020838144/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581965.296294:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020838144:0@lo:400: 00010000:00080000:3.0:1788581965.296310:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dabdd1500 x1875464020838272/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581965.296318:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875464020838272:0@lo:400: 00010000:00080000:3.0:1788581965.296349:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dabdd2d80 x1875464020838016/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581965.296357:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020838016:0@lo:400: 00010000:00080000:3.0:1788581965.296365:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dabdd1180 x1875464020837888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581981 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581965.296373:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020837888:0@lo:400: 00000100:00100000:1.0:1788581965.296481:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020837760 00000100:00100000:1.0:1788581965.296485:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020837760 00000100:00100000:1.0:1788581965.296526:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788581965.296533:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3331450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:3309:x1875464020837760:12345-0@lo:400: 00000100:00100000:1.0:1788581965.296571:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3331450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:3309:x1875464020837760:12345-0@lo:400: Request processed in 38us (1064us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581965.296577:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788581965.298361:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020837760:0@lo:400: 00010000:00010000:0.0:1788581965.549425:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581966.574298:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788581967.087022:0:7988:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg112-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788581967.602135:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788581967.854056:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788581967.854068:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0dac39a800 from 30 10000000:01000000:0.0:1788581967.854075:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788581967.854137:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d80031800/0x2bc3aa892c3a6adc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581967.854151:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d80031800/0x2bc3aa892c3a6adc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581967.854190:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d80031800/0x2bc3aa892c3a6adc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581967.854411:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020838400:0@lo:101: 00000100:00100000:0.0:1788581967.854513:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581967.854587:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da786b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788581967.854756:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020838400 00000100:00100000:3.0:1788581967.854778:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020838400 00000100:00100000:0.0:1788581967.855105:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788581967.855121:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:5840:x1875464020838400:12345-0@lo:101: 00010000:00010000:0.0:1788581967.855142:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581967.855174:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d80030c00/0x2bc3aa892c3a6ae3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6adc expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581967.855997:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d80030c00/0x2bc3aa892c3a6ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6adc expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581967.856017:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d80030c00/0x2bc3aa892c3a6ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6adc expref: 14 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581967.856029:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d80030c00, rc 0) 00000100:00100000:0.0:1788581967.856125:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:5840:x1875464020838400:12345-0@lo:101: Request processed in 1008us (1611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581967.856133:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788581967.857119:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020838400:0@lo:101: 00010000:00010000:2.0:1788581967.857149:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d80031800/0x2bc3aa892c3a6adc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6ae3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581967.857179:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d80031800/0x2bc3aa892c3a6adc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6ae3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581967.858340:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7722a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020838528:0@lo:501: 00000100:00100000:2.0:1788581967.858423:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581967.858471:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d9dd5e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581967.859076:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020838528 00000100:00100000:3.0:1788581967.859088:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020838528 00000100:00100000:3.0:1788581967.859154:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788581967.859175:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:5840:x1875464020838528:12345-0@lo:501: 00000100:00100000:3.0:1788581967.862672:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:5840:x1875464020838528:12345-0@lo:501: Request processed in 3486us (4235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581967.862692:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788581967.863358:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7722a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020838528:0@lo:501: 00000100:00100000:2.0:1788581967.863433:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7722a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020838656:0@lo:503: 00000100:00100000:2.0:1788581967.863511:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581967.863556:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d9dd5e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581967.863699:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020838656 00000100:00100000:0.0:1788581967.863708:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020838656 00000100:00100000:0.0:1788581967.863791:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788581967.863804:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:5840:x1875464020838656:12345-0@lo:503: 00000100:00100000:0.0:1788581967.864667:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:5840:x1875464020838656:12345-0@lo:503: Request processed in 860us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581967.864687:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788581967.864781:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7722a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020838656:0@lo:503: 00000100:00100000:3.0:1788581967.868111:0:8020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8020:1875464020838784:0@lo:502: 00000100:00100000:3.0:1788581967.869039:0:8020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581967.869106:0:8020:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c8364bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581967.870021:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020838784 00000100:00100000:0.0:1788581967.870037:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020838784 00000100:00100000:0.0:1788581967.870114:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788581967.870127:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3333450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:8020:x1875464020838784:12345-0@lo:502: 00000100:00100000:0.0:1788581967.872028:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3333450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:8020:x1875464020838784:12345-0@lo:502: Request processed in 1891us (2980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581967.872044:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788581967.872396:0:8020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8020:1875464020838784:0@lo:502: 00000100:00100000:3.0:1788581967.872500:0:8020:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8020:1875464020838912:0@lo:502: 00000100:00100000:3.0:1788581967.872575:0:8020:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581967.872627:0:8020:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c8364bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581967.872699:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020838912 00000100:00100000:0.0:1788581967.872707:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020838912 00000100:00100000:0.0:1788581967.873069:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788581967.873083:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:8020:x1875464020838912:12345-0@lo:502: 00000100:00100000:0.0:1788581967.873473:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:8020:x1875464020838912:12345-0@lo:502: Request processed in 392us (897us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581967.873481:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788581967.875838:0:8020:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd1f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8020:1875464020838912:0@lo:502: 00000040:00080000:2.0:1788581967.875927:0:8020:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788581967.876555:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788581967.876583:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788581967.876599:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d80031800/0x2bc3aa892c3a6adc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6ae3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581967.876614:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d80031800/0x2bc3aa892c3a6adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6ae3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581967.876627:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788581967.876631:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788581967.876635:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788581967.876705:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d80031600/0x2bc3aa892c3a6aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581967.876713:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d80031600/0x2bc3aa892c3a6aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581967.876725:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d80031600/0x2bc3aa892c3a6aea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581967.876751:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020839040:0@lo:101: 00000100:00100000:0.0:1788581967.876835:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581967.876889:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da786b480 going to sleep for 11 seconds 00000100:00100000:3.0:1788581967.877007:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020839040 00000100:00100000:3.0:1788581967.877017:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020839040 00000100:00100000:3.0:1788581967.877070:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788581967.877093:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:5840:x1875464020839040:12345-0@lo:101: 00010000:00010000:3.0:1788581967.877110:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581967.877125:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d88e26000/0x2bc3aa892c3a6af1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6aea expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581967.877153:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d88e26000/0x2bc3aa892c3a6af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6aea expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581967.877176:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d88e26000/0x2bc3aa892c3a6af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6aea expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581967.877187:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26000, rc 0) 00000100:00100000:3.0:1788581967.877267:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:5840:x1875464020839040:12345-0@lo:101: Request processed in 175us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581967.877274:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788581967.877670:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020839040:0@lo:101: 00010000:00010000:2.0:1788581967.877688:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d80031600/0x2bc3aa892c3a6aea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6af1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581967.877699:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d80031600/0x2bc3aa892c3a6aea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6af1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581967.877774:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7722a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020839168:0@lo:501: 00000100:00100000:2.0:1788581967.877808:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581967.877845:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d9dd5e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788581967.878391:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020839168 00000100:00100000:0.0:1788581967.878399:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020839168 00000100:00100000:0.0:1788581967.878455:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788581967.878466:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3332c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:5840:x1875464020839168:12345-0@lo:501: 00000100:00100000:0.0:1788581967.879525:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3332c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:5840:x1875464020839168:12345-0@lo:501: Request processed in 1054us (1709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581967.879539:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788581967.879689:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7722a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020839168:0@lo:501: 00000100:00100000:3.0:1788581967.879775:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020839296:0@lo:503: 00000100:00100000:3.0:1788581967.879841:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581967.880073:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c8364b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581967.883353:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020839296 00000100:00100000:0.0:1788581967.883377:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020839296 00000100:00100000:1.0:1788581967.889808:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788581967.889844:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:5840:x1875464020839296:12345-0@lo:503: 00000100:00100000:1.0:1788581967.892406:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:5840:x1875464020839296:12345-0@lo:503: Request processed in 2569us (12552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581967.892425:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788581967.892548:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020839296:0@lo:503: 00000100:00100000:1.0:1788581967.892881:0:8021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8021:1875464020839424:0@lo:502: 00000100:00100000:1.0:1788581967.892957:0:8021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581967.901377:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020839424 00000100:00100000:0.0:1788581967.901402:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020839424 00000100:00100000:0.0:1788581967.901481:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788581967.901496:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:8021:x1875464020839424:12345-0@lo:502: 00000100:00100000:0.0:1788581967.902563:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:8021:x1875464020839424:12345-0@lo:502: Request processed in 1063us (9598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581967.902576:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788581967.903361:0:8021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbae98cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581967.903403:0:8021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8021:1875464020839424:0@lo:502: 00000020:01000000:1.0:1788581967.903455:0:8021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581967.903468:0:8021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581967.903471:0:8021:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788581967.903476:0:8021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788581967.903478:0:8021:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788581967.903520:0:8021:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8021:1875464020839552:0@lo:502: 00000100:00100000:1.0:1788581967.903584:0:8021:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581967.903607:0:8021:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbae98cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581967.904599:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020839552 00000100:00100000:0.0:1788581967.904622:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020839552 00000100:00100000:0.0:1788581967.904684:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788581967.904696:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:8021:x1875464020839552:12345-0@lo:502: 00000100:00100000:1.0:1788581967.907114:0:8021:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8021:1875464020839552:0@lo:502: 00000020:01000000:1.0:1788581967.907193:0:8021:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581967.907994:0:8021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581967.908001:0:8021:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788581967.908007:0:8021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000100:00100000:0.0:1788581967.908359:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:8021:x1875464020839552:12345-0@lo:502: Request processed in 3659us (4769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581967.908375:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000020:01000000:2.0:1788581967.908930:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1788581967.908961:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788581967.908976:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d80031600/0x2bc3aa892c3a6aea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6af1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581967.908991:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d80031600/0x2bc3aa892c3a6aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6af1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581967.909018:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788581967.909021:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0d945e5800 from 30 10000000:01000000:2.0:1788581967.909025:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788581967.909076:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6af8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581967.909086:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6af8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581967.909099:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6af8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581967.909129:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020839680:0@lo:101: 00000100:00100000:2.0:1788581967.909241:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581967.909285:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d9dd5e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788581967.910092:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020839680 00000100:00100000:0.0:1788581967.910106:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020839680 00000100:00100000:0.0:1788581967.910191:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788581967.911183:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:5840:x1875464020839680:12345-0@lo:101: 00010000:00010000:0.0:1788581967.911549:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581967.911581:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d80030e00/0x2bc3aa892c3a6aff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6af8 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581967.911622:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d80030e00/0x2bc3aa892c3a6aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6af8 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581967.911635:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d80030e00/0x2bc3aa892c3a6aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6af8 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581967.911646:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d80030e00, rc 0) 00000100:00100000:0.0:1788581967.912094:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:5840:x1875464020839680:12345-0@lo:101: Request processed in 1890us (2851us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581967.912104:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788581967.926437:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7723480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020839680:0@lo:101: 00010000:00010000:1.0:1788581967.926483:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6af8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6aff expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581967.926501:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6af8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6aff expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581967.927494:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020839808:0@lo:501: 00000100:00100000:1.0:1788581967.927590:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581967.927654:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbae98cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581967.927754:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020839808 00000100:00100000:3.0:1788581967.927784:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020839808 00000100:00100000:3.0:1788581967.927854:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788581967.927867:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:5840:x1875464020839808:12345-0@lo:501: 00000100:00100000:1.0:1788581967.937926:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020839808:0@lo:501: 00000100:00100000:1.0:1788581967.938013:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020839936:0@lo:503: 00000100:00100000:1.0:1788581967.938092:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581967.938145:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbae98cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581967.938421:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020839936 00000100:00100000:0.0:1788581967.938431:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020839936 00000100:00100000:0.0:1788581967.938503:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788581967.938515:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020839936:12345-0@lo:503: 00000100:00100000:0.0:1788581967.939013:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020839936:12345-0@lo:503: Request processed in 498us (919us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581967.939030:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788581967.939191:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:5840:x1875464020839808:12345-0@lo:501: Request processed in 9855us (10129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581967.939301:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788581967.939467:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020839936:0@lo:503: 00000100:00100000:3.0:1788581967.940173:0:8023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8023:1875464020840064:0@lo:502: 00000100:00100000:3.0:1788581967.940405:0:8023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581967.940456:0:8023:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c8364b540 going to sleep for 11 seconds 00000100:00100000:0.0:1788581967.940509:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020840064 00000100:00100000:0.0:1788581967.940518:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020840064 00000100:00100000:0.0:1788581967.940575:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788581967.940585:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:8023:x1875464020840064:12345-0@lo:502: 00000100:00100000:0.0:1788581967.940907:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:8023:x1875464020840064:12345-0@lo:502: Request processed in 323us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581967.940917:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788581967.941596:0:8023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8023:1875464020840064:0@lo:502: 00000100:00100000:3.0:1788581967.941675:0:8023:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8023:1875464020840192:0@lo:502: 00000100:00100000:3.0:1788581967.941736:0:8023:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581967.941778:0:8023:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c8364b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788581967.942030:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020840192 00000100:00100000:2.0:1788581967.942037:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020840192 00000100:00100000:2.0:1788581967.942086:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788581967.942096:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:8023:x1875464020840192:12345-0@lo:502: 00000100:00100000:2.0:1788581967.942403:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:8023:x1875464020840192:12345-0@lo:502: Request processed in 307us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581967.942412:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788581967.944140:0:8023:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd2d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8023:1875464020840192:0@lo:502: 00000040:00080000:3.0:1788581967.944250:0:8023:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788581967.945366:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788581967.945398:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788581967.945413:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6af8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6aff expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581967.945428:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6af8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6aff expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581967.945441:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788581967.945445:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d0d945e5800 from 5 10000000:01000000:1.0:1788581967.945448:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788581967.945507:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a6b06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581967.945516:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a6b06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581967.945530:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a6b06 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581967.945558:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020840320:0@lo:101: 00000100:00100000:1.0:1788581967.945643:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581967.945697:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbae98840 going to sleep for 11 seconds 00000100:00100000:0.0:1788581967.945791:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020840320 00000100:00100000:0.0:1788581967.945801:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020840320 00000100:00100000:0.0:1788581967.945863:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788581967.945874:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:5840:x1875464020840320:12345-0@lo:101: 00010000:00010000:0.0:1788581967.946014:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581967.946067:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0da7089600/0x2bc3aa892c3a6b0d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6b06 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581967.946100:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0da7089600/0x2bc3aa892c3a6b0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6b06 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581967.946110:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0da7089600/0x2bc3aa892c3a6b0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6b06 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581967.946120:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7089600, rc 0) 00000100:00100000:0.0:1788581967.946189:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020840320:12345-0@lo:101: Request processed in 317us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581967.946197:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788581967.947298:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020840320:0@lo:101: 00010000:00010000:1.0:1788581967.947325:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a6b06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6b0d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581967.947339:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a6b06 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6b0d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581967.947431:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020840448:0@lo:256: 00000100:00100000:1.0:1788581967.947491:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581967.947528:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbae98840 going to sleep for 11 seconds 00000100:00100000:0.0:1788581967.947881:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020840448 00000100:00100000:0.0:1788581967.947958:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020840448 00000100:00100000:0.0:1788581967.948029:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788581967.948039:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020840448:12345-0@lo:256: 20000000:01000000:0.0:1788581967.948062:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788581967.948082:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788581967.948086:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:3.0:1788581967.948360:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020840448:0@lo:256: 10000000:01000000:3.0:1788581967.948414:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788581967.948422:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a6b06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6b0d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581967.948432:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a6b06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6b0d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581967.948443:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788581967.948446:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1788581967.948449:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788581967.948480:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27c00/0x2bc3aa892c3a6b14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581967.948498:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27c00/0x2bc3aa892c3a6b14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581967.948509:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27c00/0x2bc3aa892c3a6b14 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581967.948527:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020840576:0@lo:101: 00000100:00100000:3.0:1788581967.948562:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581967.948593:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c8364b540 going to sleep for 11 seconds 00000100:00100000:1.0:1788581967.948661:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020840576 00000100:00100000:1.0:1788581967.948666:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020840576 00000100:00100000:1.0:1788581967.948690:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788581967.948697:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020840576:12345-0@lo:101: 00010000:00010000:1.0:1788581967.948707:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581967.948722:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8167d600/0x2bc3aa892c3a6b1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6b14 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581967.948744:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8167d600/0x2bc3aa892c3a6b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6b14 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581967.948754:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8167d600/0x2bc3aa892c3a6b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6b14 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581967.949449:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8167d600, rc 0) 00000100:00100000:1.0:1788581967.949511:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020840576:12345-0@lo:101: Request processed in 812us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581967.949520:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788581967.949598:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020840448:12345-0@lo:256: Request processed in 162us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581967.949610:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788581967.949760:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020840576:0@lo:101: 00010000:00010000:3.0:1788581967.950016:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27c00/0x2bc3aa892c3a6b14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6b1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581967.950030:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27c00/0x2bc3aa892c3a6b14 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6b1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581967.950110:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020840704:0@lo:501: 00000100:00100000:3.0:1788581967.950149:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581967.950361:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c8364b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788581967.951602:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020840704 00000100:00100000:2.0:1788581967.951616:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020840704 00000100:00100000:3.0:1788581967.951994:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788581967.952007:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020840704:12345-0@lo:501: 00000100:00100000:3.0:1788581967.952475:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020840704:12345-0@lo:501: Request processed in 470us (2324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581967.952484:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788581967.952623:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020840704:0@lo:501: 00000100:00100000:0.0:1788581967.952683:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020840832:0@lo:503: 00000100:00100000:0.0:1788581967.952750:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581967.953649:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c33c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581967.953857:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020840832 00000100:00100000:1.0:1788581967.953868:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020840832 00000100:00100000:0.0:1788581967.957516:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788581967.957545:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020840832:12345-0@lo:503: 00000100:00100000:0.0:1788581967.958393:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020840832:12345-0@lo:503: Request processed in 857us (5637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581967.958405:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788581967.958564:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020840832:0@lo:503: 00000100:00100000:1.0:1788581967.960003:0:8024:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8024:1875464020840960:0@lo:502: 00000100:00100000:1.0:1788581967.960086:0:8024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581967.960176:0:8024:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbae983c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581967.960513:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020840960 00000100:00100000:0.0:1788581967.960522:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020840960 00000100:00100000:0.0:1788581967.960621:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788581967.960631:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:8024:x1875464020840960:12345-0@lo:502: 00000100:00100000:0.0:1788581967.961028:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:8024:x1875464020840960:12345-0@lo:502: Request processed in 396us (940us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581967.961036:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788581967.961124:0:8024:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8024:1875464020840960:0@lo:502: 00000020:01000000:1.0:1788581967.961168:0:8024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788581967.961178:0:8024:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788581967.961186:0:8024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581967.961189:0:8024:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788581967.961193:0:8024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788581967.961198:0:8024:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.112@tcp to nid 0x20000c0a8c970 (192.168.201.112@tcp) 00000020:01000000:1.0:1788581967.961249:0:8024:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788581967.961252:0:8024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788581967.961272:0:8024:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d0dbfb43370) 00000020:00000080:1.0:1788581967.961300:0:8024:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1788581967.961305:0:8024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788581967.961608:0:8024:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788581967.961616:0:8024:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788581967.961625:0:8024:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bc3aa892c3a6b29 00010000:00080000:1.0:1788581967.961660:0:8024:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d0d920f5000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.112@tcp at head 00010000:00010000:1.0:1788581967.961937:0:8024:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1788581967.962325:0:8024:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788581967.962349:0:8024:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788581967.962879:0:8024:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581967.963074:0:8024:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788581967.963134:0:8024:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788581967.963250:0:8024:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1788581967.964628:0:8025:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788581967.964636:0:8025:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788581967.968136:0:8024:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788581967.968186:0:8024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788581967.968566:0:8024:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788581967.968597:0:8024:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bc3aa892c3a6b30 00000100:00080000:2.0:1788581967.968612:0:8024:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788581967.968620:0:8024:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d0d920f5000 using connection 192.168.201.112@tcp/0@lo 00000100:00100000:2.0:1788581967.968668:0:8024:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0db7721180 x1875464020841088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788581967.968703:0:8024:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788581967.968984:0:8024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581967.968990:0:8024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581967.968993:0:8024:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788581967.968997:0:8024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788581967.969002:0:8024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581967.969003:0:8024:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788581967.969007:0:8024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788581967.969008:0:8024:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788581967.969048:0:8024:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7721500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8024:1875464020841216:0@lo:502: 00000100:00100000:2.0:1788581967.969169:0:8024:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581967.969466:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020841216 00000100:00100000:2.0:1788581967.969475:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020841216 00000100:00100000:2.0:1788581967.969528:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788581967.969539:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:8024:x1875464020841216:12345-0@lo:502: 00000100:00100000:2.0:1788581967.970417:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:8024:x1875464020841216:12345-0@lo:502: Request processed in 875us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581967.970428:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788581967.970502:0:8024:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d9dd5ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581967.970531:0:8024:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7721500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8024:1875464020841216:0@lo:502: 00000020:01000000:2.0:1788581967.970568:0:8024:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581967.970583:0:8024:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581967.970586:0:8024:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788581967.970591:0:8024:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000100:00100000:3.0:1788581967.970930:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020841088:0@lo:8: 00000100:00100000:3.0:1788581967.970987:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581967.971046:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020841088 00000100:00100000:3.0:1788581967.971052:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020841088 00000100:00100000:3.0:1788581967.971083:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788581967.971091:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1875464020841088:12345-0@lo:8: 00010000:00080000:3.0:1788581967.971125:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:3.0:1788581967.971176:0:6693:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bc3aa892c3a6b37 00002000:00100000:3.0:1788581967.971197:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d0dbfa10000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1788581967.971232:0:6693:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1788581967.971237:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1788581967.971400:0:6693:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1788581967.971601:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788581967.971636:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8d0dbfa12800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581967.971696:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875464020841088:12345-0@lo:8: Request processed in 604us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581967.971705:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788581967.971755:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0db7721180 x1875464020841088/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788581977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581967.972110:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788581967.972122:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788581967.972133:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788581967.972141:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788581967.972144:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0d920f5000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788581967.972170:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788581967.972177:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020841088:0@lo:8: 00000020:01000000:0.0:1788581967.972476:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788581967.972509:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788581967.972539:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27c00/0x2bc3aa892c3a6b14 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6b1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581967.972552:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27c00/0x2bc3aa892c3a6b14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6b1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581967.972564:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788581967.972567:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d0d9dde8000 from 1 10000000:01000000:0.0:1788581967.972572:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788581967.972615:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7088e00/0x2bc3aa892c3a6b3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581967.972624:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0da7088e00/0x2bc3aa892c3a6b3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581967.972634:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0da7088e00/0x2bc3aa892c3a6b3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581967.972658:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020841344:0@lo:101: 00000100:00100000:0.0:1788581967.972716:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581967.972779:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c3480 going to sleep for 11 seconds 00000100:00100000:3.0:1788581967.973698:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020841344 00000100:00100000:3.0:1788581967.973711:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020841344 00000100:00100000:3.0:1788581967.973792:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788581967.973815:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020841344:12345-0@lo:101: 00010000:00010000:3.0:1788581967.973834:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581967.973866:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a6b45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6b3e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581967.974136:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a6b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6b3e expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581967.974153:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a6b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6b3e expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581967.974177:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27000, rc 0) 00000100:00100000:3.0:1788581967.974386:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020841344:12345-0@lo:101: Request processed in 571us (1668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581967.974394:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788581967.974465:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020841344:0@lo:101: 00010000:00010000:3.0:1788581967.974484:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0da7088e00/0x2bc3aa892c3a6b3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6b45 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581967.974494:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0da7088e00/0x2bc3aa892c3a6b3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6b45 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581967.974578:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020841472:0@lo:501: 00000100:00100000:3.0:1788581967.974613:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581967.974647:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c8364b540 going to sleep for 11 seconds 00000100:00100000:2.0:1788581967.975187:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020841472 00000100:00100000:2.0:1788581967.975197:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020841472 00000100:00100000:2.0:1788581967.975354:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788581967.975364:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020841472:12345-0@lo:501: 00000100:00100000:2.0:1788581967.975672:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020841472:12345-0@lo:501: Request processed in 309us (1058us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788581967.975681:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788581967.976154:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020841472:0@lo:501: 10000000:01000000:3.0:1788581967.976299:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788581967.976311:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7088e00/0x2bc3aa892c3a6b3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6b45 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581967.976335:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0da7088e00/0x2bc3aa892c3a6b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6b45 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788581967.976483:0:8025:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788581967.976640:0:8025:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 186970437520ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788581967.977132:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581967.977153:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875464020841600:0@lo:400: 00000100:00100000:1.0:1788581967.977253:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581967.977311:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020841600 00000100:00100000:1.0:1788581967.977328:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020841600 00000100:00100000:1.0:1788581967.977394:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788581967.977403:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875464020841600:12345-0@lo:400: 00000100:00100000:1.0:1788581967.977459:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875464020841600:12345-0@lo:400: Request processed in 56us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581967.977466:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788581967.977508:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dac38e300 x1875464020841600/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581967.977522:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875464020841600:0@lo:400: 00000100:00100000:1.0:1788581967.977560:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875464020841728:0@lo:400: 00000100:00100000:1.0:1788581967.977583:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581967.977612:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020841728 00000100:00100000:1.0:1788581967.977616:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020841728 00000100:00100000:1.0:1788581967.977652:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788581967.977659:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875464020841728:12345-0@lo:400: 00000100:00100000:1.0:1788581967.977692:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875464020841728:12345-0@lo:400: Request processed in 34us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581967.977698:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788581967.977722:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788581967.977756:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dac38e300 x1875464020841728/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581967.977775:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875464020841728:0@lo:400: 00000100:00100000:1.0:1788581967.977813:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020841856:0@lo:400: 00000100:00100000:1.0:1788581967.977843:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581967.978381:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020841856 00000100:00100000:1.0:1788581967.978389:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020841856 00000100:00100000:1.0:1788581967.978460:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788581967.978469:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020841856:12345-0@lo:400: 00000100:00100000:1.0:1788581967.978519:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020841856:12345-0@lo:400: Request processed in 52us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581967.978526:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788581967.978558:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dac38e300 x1875464020841856/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581967.978571:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020841856:0@lo:400: 00000100:00100000:1.0:1788581967.978622:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875464020841984:0@lo:400: 00000100:00100000:1.0:1788581967.978652:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581967.978682:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020841984 00000100:00100000:1.0:1788581967.978686:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020841984 00000100:00100000:1.0:1788581967.978715:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788581967.978722:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875464020841984:12345-0@lo:400: 00000100:00080000:2.0:1788581967.978836:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581967.978841:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581967.979190:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875464020841984:12345-0@lo:400: Request processed in 466us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581967.979198:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788581967.980525:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dac38e300 x1875464020841984/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581967.980544:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875464020841984:0@lo:400: 00000004:00080000:0.0:1788581968.097922:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1788581968.098618:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020842112:0@lo:13: 00000100:00100000:0.0:1788581968.098694:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581968.098744:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020842112 00000100:00100000:2.0:1788581968.098754:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020842112 00000004:00080000:3.0:1788581968.099026:0:8026:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788581968.099069:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788581968.099079:0:8026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8026:1875464020842240:0@lo:7: 00000100:00100000:2.0:1788581968.099092:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875464020842112:12345-0@lo:13: 00002000:00000024:2.0:1788581968.099127:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1788581968.099182:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875464020842112:12345-0@lo:13: Request processed in 102us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581968.099191:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788581968.099349:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788581968.099364:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dabdd0000 x1875464020842112/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581968.099386:0:8026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581968.099401:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020842112:0@lo:13: 00000100:00100000:3.0:1788581968.099432:0:8026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c8364bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788581968.099435:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020842240 00000100:00100000:2.0:1788581968.099443:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020842240 00000100:00100000:2.0:1788581968.099479:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788581968.099489:0:6692:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788581968.099496:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8026:x1875464020842240:12345-0@lo:7: 00000100:00100000:0.0:1788581968.099498:0:6692:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:2.0:1788581968.104224:0:6691:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788581968.104300:0:6691:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788581968.104407:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8026:x1875464020842240:12345-0@lo:7: Request processed in 4916us (5029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581968.104418:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788581968.105263:0:8026:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dabdd0380 x1875464020842240/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788581984 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581968.105297:0:8026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8026:1875464020842240:0@lo:7: 00000004:00080000:3.0:1788581968.105318:0:8026:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1788581968.105380:0:8026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8026:1875464020842368:0@lo:5: 00000100:00100000:3.0:1788581968.105448:0:8026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581968.105501:0:8026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c8364bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788581968.106747:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020842368 00000100:00100000:1.0:1788581968.106775:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020842368 00000100:00100000:1.0:1788581968.106878:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788581968.106903:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8026:x1875464020842368:12345-0@lo:5: 00002000:00080000:1.0:1788581968.106952:0:6693:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788581968.106958:0:6693:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788581968.107515:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8026:x1875464020842368:12345-0@lo:5: Request processed in 623us (2065us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788581968.107526:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788581968.107565:0:8026:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dabdd0380 x1875464020842368/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788581984 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581968.107798:0:8026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd0380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8026:1875464020842368:0@lo:5: 00000004:00080000:3.0:1788581968.107816:0:8026:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1788581968.107867:0:8026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8026:1875464020842496:0@lo:700: 00000100:00100000:3.0:1788581968.107910:0:8026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581968.119244:0:6699:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020842496 00000100:00100000:0.0:1788581968.119269:0:6699:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020842496 00000100:00100000:0.0:1788581968.119362:0:6699:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788581968.119376:0:6699:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8026:x1875464020842496:12345-0@lo:700: 00000100:00100000:0.0:1788581968.119467:0:6699:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702d880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6699:1875464020842624:0@lo:700: 00000100:00100000:0.0:1788581968.119564:0:6699:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581968.119624:0:6699:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581968.121146:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020842624 00000100:00100000:0.0:1788581968.121173:0:5850:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020842624 00000100:00100000:0.0:1788581968.121290:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788581968.121307:0:5850:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6699:x1875464020842624:12345-0@lo:700: 00000100:00100000:2.0:1788581968.121332:0:8026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c8364bd80 going to sleep for 11 seconds 40000000:02000000:0.0:1788581968.188518:0:5850:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1788581968.201433:0:5850:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6699:x1875464020842624:12345-0@lo:700: Request processed in 80118us (81853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581968.201476:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788581968.201504:0:6699:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0da702d880 x1875464020842624/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788581984 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581968.201527:0:6699:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702d880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6699:1875464020842624:0@lo:700: 40000000:02000000:0.0:1788581968.201597:0:6699:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:0.0:1788581968.331503:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:0.0:1788581968.331529:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788581968.332886:0:6699:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8026:x1875464020842496:12345-0@lo:700: Request processed in 213500us (224962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581968.332928:0:6699:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788581968.333034:0:8026:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dabdd1880 x1875464020842496/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788581984 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581968.333049:0:8026:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788581968.333073:0:8026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd1880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8026:1875464020842496:0@lo:700: 00000004:02000040:1.0:1788581968.397487:0:8026:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1788581968.403356:0:8026:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8026:1875464020842752:0@lo:5: 00000100:00100000:0.0:1788581968.403461:0:8026:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581968.403594:0:8026:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c3f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788581968.405092:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020842752 00000100:00100000:3.0:1788581968.405108:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020842752 00000100:00100000:3.0:1788581968.405346:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788581968.405362:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:8026:x1875464020842752:12345-0@lo:5: 00002000:00080000:0.0:1788581968.417678:0:8034:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1788581968.417709:0:8034:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:1.0:1788581968.429545:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8026:x1875464020842752:12345-0@lo:5: Request processed in 24165us (26062us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788581968.429563:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788581968.430136:0:8026:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0da702d880 x1875464020842752/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788581984 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581968.430189:0:8026:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8026:1875464020842752:0@lo:5: 00000004:00080000:0.0:1788581968.430239:0:8026:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1788581968.628228:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581969.645403:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581969.901907:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020842880:0@lo:13: 00000100:00100000:0.0:1788581969.902021:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581969.902453:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020842880 00000100:00100000:2.0:1788581969.902465:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020842880 00000100:00100000:2.0:1788581969.902555:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788581969.902568:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020842880:12345-0@lo:13: 00002000:00000024:2.0:1788581969.902617:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581969.902785:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020842880:12345-0@lo:13: Request processed in 219us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581969.902794:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1788581969.902883:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0db7721500 x1875464020842880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581985 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581969.902904:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020842880:0@lo:13: 00000100:00080000:0.0:1788581969.902969:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788581970.676669:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581971.695133:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581972.718718:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788581972.980295:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:0.0:1788581973.473395:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788581973.473536:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001945728 00000100:00100000:3.0:1788581973.473550:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001945728 00000100:00100000:3.0:1788581973.473603:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 111 00000100:00100000:3.0:1788581973.473613:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2348:x1875464001945728:12345-192.168.201.12@tcp:250: 00010000:00080000:3.0:1788581973.473648:0:5836:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 05a4b000-bb80-4acb-83cf-d9c3916564a8@192.168.201.12@tcp t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:3.0:1788581973.473845:0:5836:0:(genops.c:1385:class_connect()) connect: client 05a4b000-bb80-4acb-83cf-d9c3916564a8, cookie 0x2bc3aa892c3a6b4c 00000100:00080000:3.0:1788581973.474017:0:5836:0:(import.c:65:import_set_state_nolock()) ffff8d0dbfa13800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581973.474339:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+5:2348:x1875464001945728:12345-192.168.201.12@tcp:250: Request processed in 725us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581973.474347:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 111 00000100:00100000:1.0:1788581973.478811:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788581973.479299:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001945856 00000100:00100000:2.0:1788581973.479312:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001945856 00000100:00100000:2.0:1788581973.479371:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 112 00000100:00100000:2.0:1788581973.479381:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+5:5575:x1875464001945856:12345-192.168.201.12@tcp:101: 00010000:00010000:2.0:1788581973.479403:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581973.479427:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8138fc00/0x2bc3aa892c3a6b53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c8fa4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581973.479476:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8138fc00/0x2bc3aa892c3a6b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fa4 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581973.479491:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8138fc00/0x2bc3aa892c3a6b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fa4 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581973.479517:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8138fc00, rc 0) 00000100:00100000:2.0:1788581973.480168:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+6:5575:x1875464001945856:12345-192.168.201.12@tcp:101: Request processed in 783us (1367us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581973.480179:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 112 00000100:00100000:1.0:1788581973.484293:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788581973.484539:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001945984 00000100:00100000:3.0:1788581973.484554:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001945984 00000100:00100000:3.0:1788581973.484635:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 113 00000100:00100000:3.0:1788581973.484648:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+6:5575:x1875464001945984:12345-192.168.201.12@tcp:501: 00000100:00100000:3.0:1788581973.485287:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+6:5575:x1875464001945984:12345-192.168.201.12@tcp:501: Request processed in 639us (1008us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788581973.485297:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 113 00000100:00100000:2.0:1788581973.487524:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020843008:0@lo:400: 00000100:00100000:2.0:1788581973.487618:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581973.487683:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020843520:0@lo:400: 00000100:00100000:2.0:1788581973.487714:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581973.487747:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788581973.487753:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020843136:0@lo:400: 00000100:00100000:2.0:1788581973.487776:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581973.487796:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020843648:0@lo:400: 00000100:00100000:2.0:1788581973.487829:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581973.487863:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020843392:0@lo:400: 00000100:00100000:2.0:1788581973.487888:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581973.487909:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788581973.487914:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875464020843264:0@lo:400: 00000100:00100000:2.0:1788581973.487937:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581973.487974:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020843520 00000100:00100000:2.0:1788581973.487983:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020843520 00000100:00100000:2.0:1788581973.488044:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020843136 00000100:00100000:2.0:1788581973.488048:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020843136 00000100:00100000:2.0:1788581973.488074:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020843264 00000100:00100000:2.0:1788581973.488077:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020843264 00000100:00100000:2.0:1788581973.488096:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788581973.488105:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020843520:12345-0@lo:400: 00000100:00100000:2.0:1788581973.488185:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7723480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020843520:12345-0@lo:400: Request processed in 80us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581973.488194:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788581973.488245:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788581973.488252:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020843136:12345-0@lo:400: 00000100:00100000:2.0:1788581973.488283:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7722a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020843136:12345-0@lo:400: Request processed in 32us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581973.488289:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788581973.488300:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788581973.488306:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875464020843264:12345-0@lo:400: 00000100:00100000:2.0:1788581973.488337:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875464020843264:12345-0@lo:400: Request processed in 31us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581973.488343:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788581973.488367:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020843648 00000100:00100000:2.0:1788581973.488372:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020843648 00000100:00100000:2.0:1788581973.488398:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020843392 00000100:00100000:2.0:1788581973.488402:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020843392 00000100:00100000:2.0:1788581973.488422:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788581973.488429:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020843648:12345-0@lo:400: 00000100:00100000:2.0:1788581973.488461:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a0b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020843648:12345-0@lo:400: Request processed in 32us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581973.488467:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788581973.488480:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788581973.488485:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020843392:12345-0@lo:400: 00000100:00100000:2.0:1788581973.488510:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a08e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020843392:12345-0@lo:400: Request processed in 26us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581973.488527:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788581973.488563:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020843008 00000100:00100000:2.0:1788581973.488566:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020843008 00000100:00100000:2.0:1788581973.488591:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788581973.488597:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020843008:12345-0@lo:400: 00000100:00100000:2.0:1788581973.488630:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020843008:12345-0@lo:400: Request processed in 33us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581973.488636:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00080000:2.0:1788581973.488687:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0db7721880 x1875464020843264/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581973.488705:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875464020843264:0@lo:400: 00010000:00080000:2.0:1788581973.488716:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0db7720700 x1875464020843392/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581973.488725:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020843392:0@lo:400: 00010000:00080000:2.0:1788581973.488758:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0db7722300 x1875464020843136/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581973.488765:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020843136:0@lo:400: 00010000:00080000:2.0:1788581973.488775:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0db7721180 x1875464020843648/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581973.488781:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788581973.488792:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020843648:0@lo:400: 00000100:00100000:2.0:1788581973.488801:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020843008:0@lo:400: 00010000:00080000:2.0:1788581973.488810:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0db7721500 x1875464020843520/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788581989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581973.488826:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7721500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020843520:0@lo:400: 00000100:00080000:2.0:1788581973.495383:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788581973.495399:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581973.495403:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788581973.495988:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581973.496017:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020843776:0@lo:13: 00000100:00100000:1.0:1788581973.496122:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581973.500019:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020843776 00000100:00100000:3.0:1788581973.500043:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020843776 00000100:00100000:1.0:1788581973.500585:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788581973.500620:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001946112 00000100:00100000:1.0:1788581973.500624:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001946112 00000100:00100000:1.0:1788581973.500682:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 115 00000100:00100000:1.0:1788581973.500695:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+6:5575:x1875464001946112:12345-192.168.201.12@tcp:101: 00010000:00010000:1.0:1788581973.500720:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581973.500746:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8167c800/0x2bc3aa892c3a6b5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c8fab expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581973.500787:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8167c800/0x2bc3aa892c3a6b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fab expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581973.500801:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8167c800/0x2bc3aa892c3a6b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fab expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581973.500813:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8167c800, rc 0) 00000100:00100000:1.0:1788581973.500890:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+7:5575:x1875464001946112:12345-192.168.201.12@tcp:101: Request processed in 198us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581973.500897:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 115 00000100:00100000:3.0:1788581973.501378:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788581973.501391:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020843776:12345-0@lo:13: 00002000:00000024:3.0:1788581973.501428:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788581973.501529:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020843776:12345-0@lo:13: Request processed in 142us (5406us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581973.501537:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788581973.502304:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dac38f480 x1875464020843776/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581973.502332:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020843776:0@lo:13: 00000100:00100000:2.0:1788581973.514576:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788581973.514729:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001946240 00000100:00100000:3.0:1788581973.514744:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001946240 00000100:00100000:3.0:1788581973.515362:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 116 00000100:00100000:3.0:1788581973.515379:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+7:5575:x1875464001946240:12345-192.168.201.12@tcp:501: 00000100:00100000:3.0:1788581973.517807:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+8:5575:x1875464001946240:12345-192.168.201.12@tcp:501: Request processed in 2417us (3231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581973.517824:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 116 00000100:00100000:1.0:1788581973.524851:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788581973.532727:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001946368 00000100:00100000:3.0:1788581973.532750:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001946368 00000100:00100000:3.0:1788581973.532840:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 117 00000100:00100000:3.0:1788581973.532854:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+8:5575:x1875464001946368:12345-192.168.201.12@tcp:503: 00000100:00100000:3.0:1788581973.533290:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+8:5575:x1875464001946368:12345-192.168.201.12@tcp:503: Request processed in 438us (8455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581973.533300:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 117 00000100:00100000:3.0:1788581973.538745:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788581973.538790:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001946496 00000100:00100000:3.0:1788581973.538800:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001946496 00000100:00100000:3.0:1788581973.538857:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 118 00000100:00100000:3.0:1788581973.538868:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+8:5593:x1875464001946496:12345-192.168.201.12@tcp:502: 00000100:00100000:3.0:1788581973.539283:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+8:5593:x1875464001946496:12345-192.168.201.12@tcp:502: Request processed in 415us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581973.539292:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 118 00000100:00100000:3.0:1788581973.568794:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788581973.568845:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001946624 00000100:00100000:3.0:1788581973.568854:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001946624 00000100:00100000:3.0:1788581973.568920:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 119 00000100:00100000:3.0:1788581973.568937:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+8:5593:x1875464001946624:12345-192.168.201.12@tcp:502: 00000100:00100000:3.0:1788581973.569645:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+8:5593:x1875464001946624:12345-192.168.201.12@tcp:502: Request processed in 710us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581973.569658:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 119 00000100:00100000:3.0:1788581973.572448:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788581973.572863:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001946752 00000100:00100000:1.0:1788581973.572880:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001946752 00000100:00100000:1.0:1788581973.572955:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 120 00000100:00100000:1.0:1788581973.572969:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+8:5575:x1875464001946752:12345-192.168.201.12@tcp:101: 00010000:00010000:1.0:1788581973.572994:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581973.573020:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8167ce00/0x2bc3aa892c3a6b61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c8fd5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581973.573071:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8167ce00/0x2bc3aa892c3a6b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fd5 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581973.573086:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8167ce00/0x2bc3aa892c3a6b61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fd5 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581973.573113:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8167ce00, rc 0) 00000100:00100000:1.0:1788581973.573244:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+9:5575:x1875464001946752:12345-192.168.201.12@tcp:101: Request processed in 276us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581973.573252:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 120 00000100:00100000:3.0:1788581973.579317:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788581973.583039:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001946880 00000100:00100000:0.0:1788581973.583059:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001946880 00000100:00100000:2.0:1788581973.583595:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 121 00000100:00100000:2.0:1788581973.583610:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+9:5575:x1875464001946880:12345-192.168.201.12@tcp:256: 20000000:01000000:2.0:1788581973.583648:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788581973.583676:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788581973.583681:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788581973.583684:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788581973.583686:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1788581973.587249:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+9:5575:x1875464001946880:12345-192.168.201.12@tcp:256: Request processed in 3624us (7929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581973.587269:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 121 00000100:00100000:2.0:1788581973.595150:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788581973.595251:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001947008 00000100:00100000:0.0:1788581973.595266:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001947008 00000100:00100000:0.0:1788581973.595335:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 122 00000100:00100000:0.0:1788581973.595347:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+9:5575:x1875464001947008:12345-192.168.201.12@tcp:101: 00010000:00010000:0.0:1788581973.595372:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581973.595397:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0da7089e00/0x2bc3aa892c3a6b68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c8fdc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581973.595436:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0da7089e00/0x2bc3aa892c3a6b68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fdc expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581973.595450:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0da7089e00/0x2bc3aa892c3a6b68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fdc expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581973.595475:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7089e00, rc 0) 00000100:00100000:0.0:1788581973.595580:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:5575:x1875464001947008:12345-192.168.201.12@tcp:101: Request processed in 234us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581973.595588:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 122 00000100:00100000:0.0:1788581973.603733:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788581973.605886:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001947136 00000100:00100000:1.0:1788581973.605905:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001947136 00000100:00100000:1.0:1788581973.605999:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 123 00000100:00100000:1.0:1788581973.606011:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:5575:x1875464001947136:12345-192.168.201.12@tcp:501: 00000100:00100000:1.0:1788581973.606426:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:5575:x1875464001947136:12345-192.168.201.12@tcp:501: Request processed in 415us (2702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581973.606438:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 123 00000100:00100000:1.0:1788581973.610094:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788581973.610184:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001947264 00000100:00100000:0.0:1788581973.610198:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001947264 00000100:00100000:0.0:1788581973.610325:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 124 00000100:00100000:0.0:1788581973.610339:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:5575:x1875464001947264:12345-192.168.201.12@tcp:503: 00000100:00100000:0.0:1788581973.610829:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:5575:x1875464001947264:12345-192.168.201.12@tcp:503: Request processed in 491us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581973.610839:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 124 00000100:00100000:2.0:1788581973.619035:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788581973.619104:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001947392 00000100:00100000:2.0:1788581973.619118:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001947392 00000100:00100000:2.0:1788581973.619185:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 125 00000100:00100000:2.0:1788581973.619197:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:5598:x1875464001947392:12345-192.168.201.12@tcp:502: 00000100:00100000:2.0:1788581973.619555:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:5598:x1875464001947392:12345-192.168.201.12@tcp:502: Request processed in 358us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581973.619565:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 125 00000100:00100000:3.0:1788581973.621640:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788581973.621990:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001947520 00000100:00100000:2.0:1788581973.622004:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001947520 00000100:00100000:2.0:1788581973.622080:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 126 00000100:00100000:2.0:1788581973.622094:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:5598:x1875464001947520:12345-192.168.201.12@tcp:502: 00000100:00100000:2.0:1788581973.622402:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:5598:x1875464001947520:12345-192.168.201.12@tcp:502: Request processed in 311us (775us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581973.622418:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 126 00000100:00100000:2.0:1788581973.624688:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788581973.624937:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001947648 00000100:00100000:3.0:1788581973.624950:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001947648 00000100:00100000:3.0:1788581973.625006:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 4 00000100:00100000:3.0:1788581973.625016:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2348:x1875464001947648:12345-192.168.201.12@tcp:38: 00010000:00080000:3.0:1788581973.625055:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:3.0:1788581973.625132:0:5843:0:(genops.c:1385:class_connect()) connect: client b99087a3-3c83-4416-b2b9-d522b9885111, cookie 0x2bc3aa892c3a6b6f 00000004:00100000:3.0:1788581973.625172:0:5843:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788581973.625179:0:5843:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1788581973.648943:0:5843:0:(import.c:65:import_set_state_nolock()) ffff8d0dbfa16800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581973.649054:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:2348:x1875464001947648:12345-192.168.201.12@tcp:38: Request processed in 24035us (24377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581973.649581:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 4 00010000:00010000:1.0:1788581973.742022:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581974.654961:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788581974.655028:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788581974.655153:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001947904 00000100:00100000:3.0:1788581974.655167:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001947904 00000100:00080000:2.0:1788581974.655432:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581974.656301:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001947776 00000100:00100000:3.0:1788581974.656313:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001947776 00000100:00100000:0.0:1788581974.659149:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 5 00000100:00100000:0.0:1788581974.659193:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+7:5575:x1875464001947904:12345-192.168.201.12@tcp:41: 00000004:00000024:0.0:1788581974.659274:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788581974.659397:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+7:5575:x1875464001947904:12345-192.168.201.12@tcp:41: Request processed in 231us (4453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581974.659405:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 5 00000100:00100000:0.0:1788581974.659449:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 6 00000100:00100000:0.0:1788581974.659468:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:0:x1875464001947776:12345-192.168.201.12@tcp:41: 00000004:00000024:0.0:1788581974.659484:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788581974.659506:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:0:x1875464001947776:12345-192.168.201.12@tcp:41: Request processed in 50us (4478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581974.659512:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 6 00000100:00100000:1.0:1788581974.665676:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788581974.682816:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001948032 00000100:00100000:0.0:1788581974.682839:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001948032 00000100:00100000:0.0:1788581974.682954:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 7 00000100:00100000:0.0:1788581974.682968:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:5575:x1875464001948032:12345-192.168.201.12@tcp:40: 00000100:00100000:0.0:1788581974.683119:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:5575:x1875464001948032:12345-192.168.201.12@tcp:40: Request processed in 154us (17460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581974.683128:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 7 00000100:00100000:2.0:1788581974.690720:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788581974.692359:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001948160 00000100:00100000:0.0:1788581974.692381:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001948160 00000100:00100000:0.0:1788581974.692479:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 8 00000100:00100000:0.0:1788581974.692492:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875464001948160:12345-192.168.201.12@tcp:8: 00010000:00080000:0.0:1788581974.692537:0:6692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:0.0:1788581974.692586:0:6692:0:(genops.c:1385:class_connect()) connect: client b99087a3-3c83-4416-b2b9-d522b9885111, cookie 0x2bc3aa892c3a6b76 00002000:00100000:0.0:1788581974.692737:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b99087a3-3c83-4416-b2b9-d522b9885111/ffff8d0dabc20800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788581974.692772:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788581974.693379:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788581974.693430:0:6692:0:(import.c:65:import_set_state_nolock()) ffff8d0dabc27800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788581974.696392:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+6:2348:x1875464001948160:12345-192.168.201.12@tcp:8: Request processed in 3886us (5676us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581974.696412:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 8 00000100:00100000:1.0:1788581974.700451:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788581974.700899:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788581974.700947:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788581974.701298:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001948288 00000100:00100000:3.0:1788581974.701332:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001948288 00000100:00100000:3.0:1788581974.701401:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 9 00000100:00100000:3.0:1788581974.701414:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875464001948288:12345-192.168.201.12@tcp:8: 00010000:00080000:3.0:1788581974.701465:0:6691:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:3.0:1788581974.701515:0:6691:0:(genops.c:1385:class_connect()) connect: client b99087a3-3c83-4416-b2b9-d522b9885111, cookie 0x2bc3aa892c3a6b7d 00002000:00100000:3.0:1788581974.701532:0:6691:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b99087a3-3c83-4416-b2b9-d522b9885111/ffff8d0dbfa11800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788581974.701549:0:6691:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788581974.702021:0:6691:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788581974.702076:0:6691:0:(import.c:65:import_set_state_nolock()) ffff8d0dbfa14800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788581974.702190:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:2348:x1875464001948288:12345-192.168.201.12@tcp:8: Request processed in 776us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581974.702257:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 9 00000100:00100000:3.0:1788581974.702389:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001948544 00000100:00100000:3.0:1788581974.702395:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001948544 00000100:00100000:3.0:1788581974.702441:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 0 00000100:00100000:3.0:1788581974.702450:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:5575:x1875464001948544:12345-192.168.201.12@tcp:33: 00000100:00100000:0.0:1788581974.708853:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001948416 00000100:00100000:0.0:1788581974.708874:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001948416 00000100:00100000:1.0:1788581974.717589:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 127 00000100:00100000:1.0:1788581974.717618:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2352:x1875464001948416:12345-192.168.201.12@tcp:400: 00000100:00100000:1.0:1788581974.717731:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2352:x1875464001948416:12345-192.168.201.12@tcp:400: Request processed in 117us (17307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581974.717740:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 127 00000004:00080000:3.0:1788581974.755571:0:5846:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 53044us 00010000:00010000:3.0:1788581974.777510:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:3.0:1788581974.795261:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788581974.795437:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:5575:x1875464001948544:12345-192.168.201.12@tcp:33: Request processed in 92978us (94478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581974.795463:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 0 00000100:00100000:2.0:1788581975.020659:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788581975.020866:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001948672 00000100:00100000:0.0:1788581975.020880:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001948672 00000100:00100000:0.0:1788581975.021125:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 8 00000100:00100000:0.0:1788581975.021140:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:5615:x1875464001948672:12345-192.168.201.12@tcp:101: 00010000:00010000:0.0:1788581975.021178:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581975.023661:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a6b84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9006 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581975.023761:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:0.0:1788581975.023768:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089a00/0x2bc3aa892c3a6b8b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581975.023784:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089a00/0x2bc3aa892c3a6b8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581975.023796:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020843904:0@lo:13: 00010000:00010000:0.0:1788581975.023802:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089a00/0x2bc3aa892c3a6b8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788581975.023844:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788581975.023848:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788581975.023865:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089a00/0x2bc3aa892c3a6b8b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581975.023898:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581975.023988:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020843904 00000100:00100000:2.0:1788581975.023998:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020843904 00000100:00100000:2.0:1788581975.024085:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788581975.024097:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020843904:12345-0@lo:13: 00002000:00000024:2.0:1788581975.024125:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581975.024177:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a09180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020843904:12345-0@lo:13: Request processed in 82us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581975.024186:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788581975.024234:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788581975.024270:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0d91a0a300 x1875464020843904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581975.024291:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a0a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020843904:0@lo:13: 00010000:00010000:0.0:1788581975.025707:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a6b84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9006 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581975.025739:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089a00/0x2bc3aa892c3a6b8b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9006 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581975.025749:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d888de100) 00010000:00010000:0.0:1788581975.025751:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788581975.025755:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7089a00, rc 0) 00000100:00100000:0.0:1788581975.025838:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+7:5615:x1875464001948672:12345-192.168.201.12@tcp:101: Request processed in 4701us (5193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581975.025848:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 8 00010000:00010000:1.0:1788581975.789840:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788581976.107054:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b99087a3-3c83-4416-b2b9-d522b9885111 00010000:00010000:1.0:1788581976.813756:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581977.220452:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788581977.222874:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001948800 00000100:00100000:2.0:1788581977.222890:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001948800 00000100:00100000:2.0:1788581977.223027:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 9 00000100:00100000:2.0:1788581977.223040:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+7:5668:x1875464001948800:12345-192.168.201.12@tcp:41: 00000004:00000024:2.0:1788581977.223100:0:5845:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788581977.223197:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+7:5668:x1875464001948800:12345-192.168.201.12@tcp:41: Request processed in 159us (2755us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581977.223241:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 9 00000100:00080000:0.0:1788581977.223729:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581977.232615:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788581977.235260:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001948928 00000100:00100000:0.0:1788581977.235294:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001948928 00000100:00100000:0.0:1788581977.235402:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 8 00000100:00100000:0.0:1788581977.235414:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b99087a3-3c83-4416-b2b9-d522b9885111+5:5668:x1875464001948928:12345-192.168.201.12@tcp:13: 00002000:00000024:0.0:1788581977.235460:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788581977.235549:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b99087a3-3c83-4416-b2b9-d522b9885111+5:5668:x1875464001948928:12345-192.168.201.12@tcp:13: Request processed in 138us (2947us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581977.235557:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 8 00000100:00080000:2.0:1788581977.236103:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788581977.239371:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788581977.239527:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001949056 00000100:00100000:0.0:1788581977.239539:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001949056 00000100:00100000:0.0:1788581977.239623:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 9 00000100:00100000:0.0:1788581977.239635:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b99087a3-3c83-4416-b2b9-d522b9885111+6:5668:x1875464001949056:12345-192.168.201.12@tcp:13: 00002000:00000024:0.0:1788581977.239676:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788581977.239766:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b99087a3-3c83-4416-b2b9-d522b9885111+6:5668:x1875464001949056:12345-192.168.201.12@tcp:13: Request processed in 132us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581977.239774:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 9 00000100:00080000:2.0:1788581977.239971:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788581977.838823:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581978.605755:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788581978.605780:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020844032:0@lo:13: 00000100:00100000:3.0:1788581978.605856:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581978.605963:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020844032 00000100:00100000:0.0:1788581978.605972:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020844032 00000100:00100000:0.0:1788581978.606048:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788581978.606059:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020844032:12345-0@lo:13: 00002000:00000024:0.0:1788581978.606082:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788581978.606126:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020844032:12345-0@lo:13: Request processed in 70us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581978.606133:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1788581978.606235:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dac38c700 x1875464020844032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788581978.606270:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020844032:0@lo:13: 00000100:00100000:3.0:1788581978.609018:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020844288:0@lo:400: 00000100:00100000:3.0:1788581978.609089:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581978.609128:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788581978.609134:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020844416:0@lo:400: 00000100:00100000:3.0:1788581978.609177:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581978.609234:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020844288 00000100:00100000:3.0:1788581978.609242:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020844288 00000100:00100000:3.0:1788581978.609283:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020844416 00000100:00100000:3.0:1788581978.609286:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020844416 00000100:00100000:3.0:1788581978.609308:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788581978.609316:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020844288:12345-0@lo:400: 00000100:00100000:3.0:1788581978.609365:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020844288:12345-0@lo:400: Request processed in 49us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581978.609372:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788581978.609388:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788581978.609394:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020844416:12345-0@lo:400: 00000100:00100000:3.0:1788581978.609418:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020844416:12345-0@lo:400: Request processed in 25us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581978.609423:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788581978.609460:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020844416:0@lo:400: 00000100:00100000:3.0:1788581978.609469:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020844288:0@lo:400: 00000100:00100000:0.0:1788581978.609557:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020844544:0@lo:400: 00000100:00100000:0.0:1788581978.609591:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581978.609609:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788581978.609622:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020844160:0@lo:400: 00000100:00100000:0.0:1788581978.609648:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788581978.609913:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788581978.609918:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788581978.610005:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020844672:0@lo:400: 00000100:00100000:0.0:1788581978.610032:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581978.610065:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020844672 00000100:00100000:0.0:1788581978.610070:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020844672 00000100:00100000:0.0:1788581978.610114:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788581978.610121:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020844672:12345-0@lo:400: 00000100:00100000:0.0:1788581978.610156:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020844672:12345-0@lo:400: Request processed in 36us (124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581978.610162:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788581978.610181:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020844160 00000100:00100000:0.0:1788581978.610184:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020844160 00000100:00100000:0.0:1788581978.610229:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788581978.610236:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020844160:12345-0@lo:400: 00000100:00100000:0.0:1788581978.610262:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020844160:12345-0@lo:400: Request processed in 26us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581978.610267:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1788581978.610311:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020844160:0@lo:400: 00000100:00100000:0.0:1788581978.610321:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020844672:0@lo:400: 00000100:00080000:1.0:1788581978.610406:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581978.610449:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020844544 00000100:00100000:3.0:1788581978.610454:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020844544 00000100:00100000:3.0:1788581978.610527:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788581978.610545:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020844544:12345-0@lo:400: 00000100:00100000:3.0:1788581978.610592:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020844544:12345-0@lo:400: Request processed in 48us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581978.610599:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788581978.612089:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dabdd2d80 x1875464020844544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581978.612107:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020844544:0@lo:400: 00000100:00080000:1.0:1788581978.612659:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788581978.864686:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788581979.202867:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b99087a3-3c83-4416-b2b9-d522b9885111 00000001:00100000:1.0:1788581979.349705:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b99087a3-3c83-4416-b2b9-d522b9885111 00010000:00010000:1.0:1788581979.886948:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581979.997609:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788581979.997656:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788581979.997683:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788581979.997720:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788581979.997750:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001949440 00000100:00100000:1.0:1788581979.997759:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001949440 00000100:00100000:1.0:1788581979.997827:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001949568 00000100:00100000:1.0:1788581979.997831:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001949568 00000100:00100000:1.0:1788581979.997857:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 7 00000100:00100000:1.0:1788581979.997868:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+5:2352:x1875464001949440:12345-192.168.201.12@tcp:400: 00000100:00100000:1.0:1788581979.997943:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+5:2352:x1875464001949440:12345-192.168.201.12@tcp:400: Request processed in 77us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581979.997961:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 7 00000100:00100000:1.0:1788581979.997978:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 8 00000100:00100000:1.0:1788581979.997985:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+5:2352:x1875464001949568:12345-192.168.201.12@tcp:400: 00000100:00100000:1.0:1788581979.998009:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+5:2352:x1875464001949568:12345-192.168.201.12@tcp:400: Request processed in 25us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581979.998015:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 8 00000100:00100000:1.0:1788581979.998034:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001949312 00000100:00100000:1.0:1788581979.998038:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001949312 00000100:00100000:1.0:1788581979.998077:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 21 00000100:00100000:1.0:1788581979.998084:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:2352:x1875464001949312:12345-192.168.201.12@tcp:400: 00000100:00100000:1.0:1788581979.998114:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:2352:x1875464001949312:12345-192.168.201.12@tcp:400: Request processed in 31us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581979.998121:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 21 00000100:00080000:1.0:1788581979.998141:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788581979.998146:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788581979.998148:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788581979.998840:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001949184 00000100:00100000:3.0:1788581979.998846:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001949184 00000100:00100000:3.0:1788581980.004133:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 129 00000100:00100000:3.0:1788581980.004156:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2352:x1875464001949184:12345-192.168.201.12@tcp:400: 00000100:00100000:3.0:1788581980.004460:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2352:x1875464001949184:12345-192.168.201.12@tcp:400: Request processed in 312us (6857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581980.004469:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 129 00000001:02000400:0.0:1788581980.110647:0:8304:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:2.0:1788581980.145711:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020844800:0@lo:13: 00000100:00100000:2.0:1788581980.145801:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581980.147279:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020844800 00000100:00100000:0.0:1788581980.147303:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020844800 00000100:00100000:0.0:1788581980.147372:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788581980.147383:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020844800:12345-0@lo:13: 00002000:00000024:0.0:1788581980.147419:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788581980.147495:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020844800:12345-0@lo:13: Request processed in 114us (1694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581980.147503:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788581980.147552:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0d91a0a680 x1875464020844800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581980.147573:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020844800:0@lo:13: 00000100:00080000:2.0:1788581980.148042:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788581980.909587:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581981.935530:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581982.957372:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581983.735097:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020845056:0@lo:13: 00000100:00100000:0.0:1788581983.735169:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581983.735228:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020844928:0@lo:400: 00000100:00100000:0.0:1788581983.735256:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581983.735285:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875464020845568:0@lo:400: 00000100:00100000:0.0:1788581983.735310:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581983.735328:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788581983.735333:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020845440:0@lo:400: 00000100:00100000:0.0:1788581983.735356:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581983.735389:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020845056 00000100:00100000:0.0:1788581983.735396:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020845056 00000100:00100000:0.0:1788581983.735448:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788581983.735457:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020845056:12345-0@lo:13: 00002000:00000024:0.0:1788581983.735489:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788581983.735530:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020845056:12345-0@lo:13: Request processed in 73us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581983.735537:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788581983.735557:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020844928 00000100:00100000:0.0:1788581983.735561:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020844928 00000100:00100000:0.0:1788581983.735582:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788581983.735588:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3307:x1875464020844928:12345-0@lo:400: 00000100:00100000:0.0:1788581983.735623:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3307:x1875464020844928:12345-0@lo:400: Request processed in 35us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581983.735630:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1788581983.735654:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020845568 00000100:00100000:0.0:1788581983.735657:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020845568 00000100:00100000:0.0:1788581983.735682:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788581983.735689:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875464020845568:12345-0@lo:400: 00000100:00100000:0.0:1788581983.735717:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875464020845568:12345-0@lo:400: Request processed in 29us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581983.735722:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788581983.735738:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020845440 00000100:00100000:0.0:1788581983.735741:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020845440 00000100:00100000:0.0:1788581983.735764:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788581983.735770:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020845440:12345-0@lo:400: 00000100:00100000:0.0:1788581983.735796:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020845440:12345-0@lo:400: Request processed in 27us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581983.735802:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:0.0:1788581983.735816:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788581983.735820:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788581983.735822:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788581983.735857:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0d90d10380 x1875464020845440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581983.735870:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020845440:0@lo:400: 00000100:00100000:0.0:1788581983.735881:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875464020845568:0@lo:400: 00010000:00080000:0.0:1788581983.736492:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0da702c000 x1875464020845056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788581999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581983.736573:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020845056:0@lo:13: 00000100:00100000:0.0:1788581983.736589:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020844928:0@lo:400: 00000100:00100000:0.0:1788581983.736745:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020845184:0@lo:400: 00000100:00100000:0.0:1788581983.736784:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581983.736806:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020845696:0@lo:400: 00000100:00100000:0.0:1788581983.736826:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581983.736843:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581983.736849:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020845312:0@lo:400: 00000100:00100000:0.0:1788581983.736868:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581983.736903:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020845184 00000100:00100000:0.0:1788581983.736909:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020845184 00000100:00100000:0.0:1788581983.736943:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020845312 00000100:00100000:0.0:1788581983.736946:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020845312 00000100:00100000:0.0:1788581983.736967:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788581983.736974:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020845184:12345-0@lo:400: 00000100:00100000:0.0:1788581983.737014:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020845184:12345-0@lo:400: Request processed in 40us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581983.737020:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788581983.737033:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788581983.737039:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020845312:12345-0@lo:400: 00000100:00100000:0.0:1788581983.737064:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020845312:12345-0@lo:400: Request processed in 26us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581983.737069:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788581983.737086:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020845696 00000100:00100000:0.0:1788581983.737089:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020845696 00000100:00100000:0.0:1788581983.737118:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788581983.737124:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020845696:12345-0@lo:400: 00000100:00100000:0.0:1788581983.737150:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020845696:12345-0@lo:400: Request processed in 27us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581983.737155:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788581983.737178:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020845312:0@lo:400: 00000100:00100000:0.0:1788581983.737186:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020845184:0@lo:400: 00010000:00080000:0.0:1788581983.737195:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0d90d10a80 x1875464020845696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788581999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788581983.737218:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020845696:0@lo:400: 00000100:00080000:0.0:1788581983.737242:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1788581983.891877:0:8453:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdb76a32a0 20000000:00000080:3.0:1788581983.891907:0:8453:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d0dbf28dc00 uarg=0000000000000000 20000000:01000000:3.0:1788581983.891997:0:8453:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1788581983.892000:0:8453:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1788581983.892002:0:8453:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788581983.892007:0:8453:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1788581983.892012:0:8453:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1788581983.892026:0:8453:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1788581983.892028:0:8453:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1788581983.892601:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788581983.892604:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788581983.893706:0:8454:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1788581983.894252:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1788581983.894499:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1788581983.894554:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1788581983.894568:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788581983.894570:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788581983.896153:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1788581983.896945:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1788581983.897006:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1788581983.897057:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1788581983.897071:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788581983.897074:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788581983.901956:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788581983.902969:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788581983.903034:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788581983.903068:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:3.0:1788581983.903083:0:8453:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1788581983.903085:0:8453:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788581983.905922:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788581983.906907:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788581983.906974:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788581983.907010:0:8453:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:3.0:1788581983.907028:0:8453:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788581983.907047:0:8453:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d0d88e27a00/0x2bc3aa892c3a6b92 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.907063:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d8138f200/0x2bc3aa892c3a6a8f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6a88 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.907071:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d80030a00/0x2bc3aa892c3a6ab9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6ab2 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.907077:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d80030c00/0x2bc3aa892c3a6ae3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6adc expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.907085:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d88e26000/0x2bc3aa892c3a6af1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6aea expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.907091:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d80030e00/0x2bc3aa892c3a6aff lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6af8 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.907098:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d8167d600/0x2bc3aa892c3a6b1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6b14 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.907113:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a6b45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6b3e expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.907125:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d8138fc00/0x2bc3aa892c3a6b53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fa4 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.907132:0:8453:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d8167c800/0x2bc3aa892c3a6b5a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fab expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.907140:0:8453:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d0d88e27a00/0x2bc3aa892c3a6b92 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.907180:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d8167c800/0x2bc3aa892c3a6b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fab expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.907196:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d0d8167c800/0x2bc3aa892c3a6b5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fab expref: 9 pid: 5837 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581983.907621:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d11880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875464020845824:192.168.201.12@tcp:104: 00010000:00010000:3.0:1788581983.907767:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d8138fc00/0x2bc3aa892c3a6b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fa4 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.907777:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d0d8138fc00/0x2bc3aa892c3a6b53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fa4 expref: 9 pid: 5837 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581983.907787:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d13b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875464020845952:192.168.201.12@tcp:104: 00010000:00010000:3.0:1788581983.907817:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a6b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a6b3e expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.907837:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a6b45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6b3e expref: 18 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581983.907846:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d10700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875464020846080:0@lo:104: 00000100:00100000:3.0:1788581983.907910:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788581983.907947:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d8167d600/0x2bc3aa892c3a6b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a6b14 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.907956:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d8167d600/0x2bc3aa892c3a6b1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6b14 expref: 18 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581983.907963:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d10e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875464020846208:0@lo:104: 00000100:00100000:3.0:1788581983.907986:0:8453:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788581983.908014:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d80030e00/0x2bc3aa892c3a6aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a6af8 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.908023:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d80030e00/0x2bc3aa892c3a6aff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6af8 expref: 18 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581983.908031:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d12a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875464020846336:0@lo:104: 00010000:00010000:3.0:1788581983.908052:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d88e26000/0x2bc3aa892c3a6af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a6aea expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.908059:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d88e26000/0x2bc3aa892c3a6af1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6aea expref: 18 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581983.908068:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d11f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875464020846464:0@lo:104: 00010000:00010000:3.0:1788581983.908087:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d80030c00/0x2bc3aa892c3a6ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a6adc expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.908101:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d80030c00/0x2bc3aa892c3a6ae3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6adc expref: 18 pid: 5836 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581983.908110:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d11180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875464020846592:0@lo:104: 00010000:00010000:3.0:1788581983.908132:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d80030a00/0x2bc3aa892c3a6ab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a6ab2 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.908139:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d80030a00/0x2bc3aa892c3a6ab9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6ab2 expref: 18 pid: 5836 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581983.908148:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d12d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875464020846720:0@lo:104: 00010000:00010000:3.0:1788581983.908166:0:8453:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d8138f200/0x2bc3aa892c3a6a8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a6a88 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.908173:0:8453:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d8138f200/0x2bc3aa892c3a6a8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a88 expref: 18 pid: 5836 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581983.908181:0:8453:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d10000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875464020846848:0@lo:104: 00000100:00100000:3.0:1788581983.908196:0:8453:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c82b94540 going to sleep for 11 seconds 00000100:00100000:0.0:1788581983.908304:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788581983.908622:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581983.908650:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581983.908662:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581983.908671:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581983.908679:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581983.908686:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020846080 00000100:00100000:0.0:1788581983.908694:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020846080 00000100:00100000:0.0:1788581983.908731:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020846208 00000100:00100000:0.0:1788581983.908734:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020846208 00000100:00100000:0.0:1788581983.908744:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020846336 00000100:00100000:0.0:1788581983.908746:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020846336 00000100:00100000:0.0:1788581983.908753:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020846464 00000100:00100000:0.0:1788581983.908755:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020846464 00000100:00100000:0.0:1788581983.908763:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020846592 00000100:00100000:0.0:1788581983.908771:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020846592 00000100:00100000:0.0:1788581983.908785:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020846720 00000100:00100000:0.0:1788581983.908787:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020846720 00000100:00100000:0.0:1788581983.908796:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020846848 00000100:00100000:0.0:1788581983.908798:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020846848 00000100:00100000:0.0:1788581983.908810:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788581983.908818:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+9:8453:x1875464020846080:12345-0@lo:104: 00010000:00010000:0.0:1788581983.908831:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0da7088e00/0x2bc3aa892c3a6b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6b45 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.908900:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581983.908906:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+9:8453:x1875464020846080:12345-0@lo:104: Request processed in 90us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581983.908913:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788581983.908930:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788581983.908936:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85a37c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+8:8453:x1875464020846208:12345-0@lo:104: 00010000:00010000:0.0:1788581983.908942:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27c00/0x2bc3aa892c3a6b14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6b1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.908976:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788581983.908982:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85a37c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+8:8453:x1875464020846208:12345-0@lo:104: Request processed in 47us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581983.908988:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788581983.909021:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788581983.909027:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+7:8453:x1875464020846336:12345-0@lo:104: 00010000:00010000:0.0:1788581983.909034:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6af8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6aff expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.909063:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788581983.909074:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+7:8453:x1875464020846336:12345-0@lo:104: Request processed in 47us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581983.909081:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788581983.909092:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788581983.909097:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+6:8453:x1875464020846464:12345-0@lo:104: 00010000:00010000:0.0:1788581983.909104:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d80031600/0x2bc3aa892c3a6aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6af1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.909127:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788581983.909131:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+6:8453:x1875464020846464:12345-0@lo:104: Request processed in 35us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581983.909136:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788581983.909146:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788581983.909151:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+5:8453:x1875464020846592:12345-0@lo:104: 00010000:00010000:0.0:1788581983.909157:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d80031800/0x2bc3aa892c3a6adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6ae3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.909182:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1788581983.909186:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+5:8453:x1875464020846592:12345-0@lo:104: Request processed in 36us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581983.909191:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788581983.909223:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788581983.909229:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+4:8453:x1875464020846720:12345-0@lo:104: 00010000:00010000:0.0:1788581983.909236:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d80031400/0x2bc3aa892c3a6ab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6ab9 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.909261:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:0.0:1788581983.909280:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+4:8453:x1875464020846720:12345-0@lo:104: Request processed in 42us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581983.909286:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788581983.909299:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1788581983.909512:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788581983.909519:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0da7088e00/0x2bc3aa892c3a6b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6b45 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909527:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088e00 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:2.0:1788581983.909543:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0da7088e00/0x2bc3aa892c3a6b3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a6b45 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909552:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0da7088e00/0x2bc3aa892c3a6b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a6b45 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581983.909559:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0da7088e00/0x2bc3aa892c3a6b3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a6b45 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581983.909576:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788581983.909612:0:7637:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0da7088e00/0x2bc3aa892c3a6b3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6b45 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909619:0:7637:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581983.909637:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0da7088e00/0x2bc3aa892c3a6b3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6b45 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909644:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0da7088e00/0x2bc3aa892c3a6b3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6b45 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909657:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788581983.909660:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27c00/0x2bc3aa892c3a6b14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6b1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909665:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27c00 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:2.0:1788581983.909668:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27c00/0x2bc3aa892c3a6b14 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a6b1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909674:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27c00/0x2bc3aa892c3a6b14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a6b1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581983.909680:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27c00/0x2bc3aa892c3a6b14 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a6b1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581983.909685:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788581983.909698:0:7637:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27c00/0x2bc3aa892c3a6b14 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6b1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909703:0:7637:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581983.909724:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27c00/0x2bc3aa892c3a6b14 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6b1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909731:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27c00/0x2bc3aa892c3a6b14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6b1b expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909739:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788581983.909741:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6af8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6aff expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909747:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8138ea00 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:2.0:1788581983.909750:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6af8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a6aff expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909756:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a6aff expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581983.909762:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6af8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a6aff expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581983.909767:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788581983.909779:0:7637:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6af8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6aff expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909785:0:7637:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581983.909789:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6af8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6aff expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909795:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6af8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6aff expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909804:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788581983.909813:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d80031600/0x2bc3aa892c3a6aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6af1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909819:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d80031600 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:2.0:1788581983.909822:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d80031600/0x2bc3aa892c3a6aea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a6af1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909828:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d80031600/0x2bc3aa892c3a6aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a6af1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581983.909833:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d80031600/0x2bc3aa892c3a6aea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a6af1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581983.909838:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788581983.909850:0:7637:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d80031600/0x2bc3aa892c3a6aea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6af1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909855:0:7637:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581983.909861:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d80031600/0x2bc3aa892c3a6aea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6af1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909866:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d80031600/0x2bc3aa892c3a6aea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6af1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909875:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788581983.909878:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d80031800/0x2bc3aa892c3a6adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6ae3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909895:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d80031800 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:2.0:1788581983.909898:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d80031800/0x2bc3aa892c3a6adc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a6ae3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909917:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d80031800/0x2bc3aa892c3a6adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a6ae3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581983.909923:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d80031800/0x2bc3aa892c3a6adc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a6ae3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581983.909927:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788581983.909940:0:7637:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d80031800/0x2bc3aa892c3a6adc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6ae3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909945:0:7637:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581983.909949:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d80031800/0x2bc3aa892c3a6adc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6ae3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909955:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d80031800/0x2bc3aa892c3a6adc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6ae3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909964:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788581983.909967:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d80031400/0x2bc3aa892c3a6ab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6ab9 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909973:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d80031400 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:2.0:1788581983.909975:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d80031400/0x2bc3aa892c3a6ab2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a6ab9 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.909982:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d80031400/0x2bc3aa892c3a6ab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a6ab9 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788581983.909987:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d80031400/0x2bc3aa892c3a6ab2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a6ab9 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581983.909997:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788581983.910020:0:7637:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d80031400/0x2bc3aa892c3a6ab2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6ab9 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.910025:0:7637:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788581983.910029:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d80031400/0x2bc3aa892c3a6ab2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6ab9 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.910034:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d80031400/0x2bc3aa892c3a6ab2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6ab9 expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.910042:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581983.910043:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788581983.910045:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581983.910067:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020846976:0@lo:103: 00000100:00100000:2.0:1788581983.910103:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581983.910136:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020847488:0@lo:103: 00000100:00100000:2.0:1788581983.910154:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581983.910173:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788581983.910179:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020847360:0@lo:103: 00000100:00100000:2.0:1788581983.910196:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581983.910260:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020847104:0@lo:103: 00000100:00100000:2.0:1788581983.910282:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581983.910297:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020847616:0@lo:103: 00000100:00100000:3.0:1788581983.910651:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d10700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875464020846080:0@lo:104: 00000100:00100000:3.0:1788581983.910662:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d10e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875464020846208:0@lo:104: 00000100:00100000:3.0:1788581983.910669:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d12a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875464020846336:0@lo:104: 00000100:00100000:3.0:1788581983.910677:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d11f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875464020846464:0@lo:104: 00000100:00100000:3.0:1788581983.910683:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d11180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875464020846592:0@lo:104: 00000100:00100000:3.0:1788581983.910689:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d12d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875464020846720:0@lo:104: 00000100:00100000:0.0:1788581983.910764:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:8453:x1875464020846848:12345-0@lo:104: 00010000:00010000:0.0:1788581983.910776:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d8167c600/0x2bc3aa892c3a6a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6a8f expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581983.910852:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020846976 00000100:00100000:3.0:1788581983.910864:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020846976 00010000:00010000:3.0:1788581983.910907:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a6b45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6b3e expref: 19 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581983.910925:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020847488 00000100:00100000:3.0:1788581983.910928:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020847488 00010000:00010000:3.0:1788581983.910938:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d80030c00/0x2bc3aa892c3a6ae3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6adc expref: 20 pid: 5836 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581983.910947:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020847360 00000100:00100000:3.0:1788581983.910950:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020847360 00010000:00010000:3.0:1788581983.910958:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d88e26000/0x2bc3aa892c3a6af1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6aea expref: 21 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581983.910966:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020847104 00000100:00100000:3.0:1788581983.910968:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020847104 00010000:00010000:3.0:1788581983.910975:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d8167d600/0x2bc3aa892c3a6b1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6b14 expref: 22 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581983.910986:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788581983.910992:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+22:3309:x1875464020846976:12345-0@lo:103: 00010000:00010000:3.0:1788581983.911001:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788581983.911006:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a6b45 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6b3e expref: 22 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.911015:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a6b45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6b3e expref: 22 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.911029:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a6b45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a6b3e expref: 22 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581983.911042:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581983.911120:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581983.911126:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd91f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:8453:x1875464020846848:12345-0@lo:104: Request processed in 1822us (2446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581983.911135:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788581983.911156:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581983.911160:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d8167c600/0x2bc3aa892c3a6a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6a8f expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.911168:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8167c600 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:0.0:1788581983.911171:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8167c600/0x2bc3aa892c3a6a88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a6a8f expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.911179:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d8167c600/0x2bc3aa892c3a6a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a6a8f expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581983.911185:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8167c600/0x2bc3aa892c3a6a88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a6a8f expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581983.911191:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788581983.911225:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d8167c600/0x2bc3aa892c3a6a88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6a8f expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.911241:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581983.911248:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d8167c600/0x2bc3aa892c3a6a88 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6a8f expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.911254:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d8167c600/0x2bc3aa892c3a6a88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6a8f expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.911269:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581983.911271:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581983.911272:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581983.911278:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581983.911837:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788581983.911847:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+21:3309:x1875464020847488:12345-0@lo:103: 00010000:00010000:1.0:1788581983.911857:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581983.911863:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d80030c00/0x2bc3aa892c3a6ae3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6adc expref: 21 pid: 5836 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581983.911873:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d80030c00/0x2bc3aa892c3a6ae3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6adc expref: 21 pid: 5836 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581983.911894:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d80030c00/0x2bc3aa892c3a6ae3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a6adc expref: 21 pid: 5836 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581983.911905:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581983.911947:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+20:3309:x1875464020847488:12345-0@lo:103: Request processed in 103us (1791us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581983.911953:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788581983.911968:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788581983.911974:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3309:x1875464020847360:12345-0@lo:103: 00010000:00010000:1.0:1788581983.911987:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581983.911992:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d88e26000/0x2bc3aa892c3a6af1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6aea expref: 19 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581983.912000:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d88e26000/0x2bc3aa892c3a6af1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6aea expref: 19 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581983.912010:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d88e26000/0x2bc3aa892c3a6af1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a6aea expref: 19 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581983.912018:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581983.912039:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:3309:x1875464020847360:12345-0@lo:103: Request processed in 66us (1842us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581983.912045:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788581983.912056:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788581983.912061:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:3306:x1875464020847104:12345-0@lo:103: 00010000:00010000:1.0:1788581983.912068:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581983.912072:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d8167d600/0x2bc3aa892c3a6b1b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6b14 expref: 17 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581983.912080:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d8167d600/0x2bc3aa892c3a6b1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6b14 expref: 17 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581983.912090:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8167d600/0x2bc3aa892c3a6b1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a6b14 expref: 17 pid: 5838 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581983.912099:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581983.912118:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:3306:x1875464020847104:12345-0@lo:103: Request processed in 57us (1835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581983.912132:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788581983.912197:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7720700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020847360:0@lo:103: 00000100:00100000:0.0:1788581983.912269:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7721880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020847488:0@lo:103: 00010000:00010000:1.0:1788581983.914005:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581983.914476:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd96680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:3309:x1875464020846976:12345-0@lo:103: Request processed in 3478us (4367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581983.914488:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788581983.914540:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020847232:0@lo:103: 00000100:00100000:3.0:1788581983.914584:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581983.914616:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020847744:0@lo:103: 00000100:00100000:3.0:1788581983.914638:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581983.914706:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d10000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875464020846848:0@lo:104: 00000100:00100000:1.0:1788581983.914921:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020847232 00000100:00100000:1.0:1788581983.914928:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020847232 00010000:00010000:1.0:1788581983.914962:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d80030e00/0x2bc3aa892c3a6aff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6af8 expref: 15 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581983.914992:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020847744 00000100:00100000:1.0:1788581983.914995:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020847744 00010000:00010000:1.0:1788581983.915006:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d8138f200/0x2bc3aa892c3a6a8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a88 expref: 16 pid: 5836 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581983.915025:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788581983.915031:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:3307:x1875464020847232:12345-0@lo:103: 00010000:00010000:1.0:1788581983.915042:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581983.915047:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d80030e00/0x2bc3aa892c3a6aff lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6af8 expref: 16 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581983.915058:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d80030e00/0x2bc3aa892c3a6aff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6af8 expref: 16 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581983.915074:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d80030e00/0x2bc3aa892c3a6aff lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a6af8 expref: 16 pid: 5837 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581983.915088:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581983.915121:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d11500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:3307:x1875464020847232:12345-0@lo:103: Request processed in 90us (536us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581983.915127:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788581983.915140:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788581983.915145:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:3307:x1875464020847744:12345-0@lo:103: 00010000:00010000:1.0:1788581983.915167:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581983.915172:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d8138f200/0x2bc3aa892c3a6a8f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a88 expref: 14 pid: 5836 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581983.915180:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d8138f200/0x2bc3aa892c3a6a8f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a88 expref: 14 pid: 5836 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581983.915190:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8138f200/0x2bc3aa892c3a6a8f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a6a88 expref: 14 pid: 5836 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581983.915228:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581983.915251:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d13800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:3307:x1875464020847744:12345-0@lo:103: Request processed in 105us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581983.915257:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788581983.915295:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7722300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020847232:0@lo:103: 00000100:00100000:1.0:1788581983.915303:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020847744:0@lo:103: 00000100:00100000:1.0:1788581983.915341:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020846976:0@lo:103: 00000100:00100000:3.0:1788581983.917648:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788581983.917676:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788581983.917730:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d11880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875464020845824:192.168.201.12@tcp:104: 00000100:00100000:3.0:1788581983.917742:0:8453:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d13b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8453:1875464020845952:192.168.201.12@tcp:104: 00010000:00010000:3.0:1788581983.917786:0:8453:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d0d88e27a00/0x2bc3aa892c3a6b92 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581983.918003:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001949824 00000100:00100000:1.0:1788581983.918011:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001949824 00010000:00010000:1.0:1788581983.918044:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d8138fc00/0x2bc3aa892c3a6b53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fa4 expref: 10 pid: 5837 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581983.918076:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001949696 00000100:00100000:1.0:1788581983.918079:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001949696 00010000:00010000:1.0:1788581983.918091:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d8167c800/0x2bc3aa892c3a6b5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fab expref: 11 pid: 5837 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581983.918148:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 18 00000100:00100000:1.0:1788581983.918168:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:05a4b000-bb80-4acb-83cf-d9c3916564a8+11:2349:x1875464001949824:12345-192.168.201.12@tcp:103: 00010000:00010000:1.0:1788581983.918182:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581983.918188:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d8138fc00/0x2bc3aa892c3a6b53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fa4 expref: 11 pid: 5837 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581983.918197:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d8138fc00/0x2bc3aa892c3a6b53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fa4 expref: 11 pid: 5837 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581983.918235:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8138fc00/0x2bc3aa892c3a6b53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fa4 expref: 11 pid: 5837 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581983.918249:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581983.918317:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2349:x1875464001949824:12345-192.168.201.12@tcp:103: Request processed in 150us (676us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581983.918396:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 18 00000100:00100000:1.0:1788581983.918417:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 19 00000100:00100000:1.0:1788581983.918424:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:05a4b000-bb80-4acb-83cf-d9c3916564a8+9:2349:x1875464001949696:12345-192.168.201.12@tcp:103: 00010000:00010000:1.0:1788581983.918432:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581983.918437:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d8167c800/0x2bc3aa892c3a6b5a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fab expref: 9 pid: 5837 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581983.918446:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d8167c800/0x2bc3aa892c3a6b5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fab expref: 9 pid: 5837 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581983.918456:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8167c800/0x2bc3aa892c3a6b5a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fab expref: 9 pid: 5837 timeout: 302 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581983.918466:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581983.918490:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d12680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:05a4b000-bb80-4acb-83cf-d9c3916564a8+8:2349:x1875464001949696:12345-192.168.201.12@tcp:103: Request processed in 67us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581983.918496:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 19 00000100:00100000:2.0:1788581983.918597:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581983.918997:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7721180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020847104:0@lo:103: 00000100:00100000:0.0:1788581983.919057:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020847616 00000100:00100000:0.0:1788581983.919062:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020847616 00010000:00010000:0.0:1788581983.919084:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d80030a00/0x2bc3aa892c3a6ab9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6ab2 expref: 13 pid: 5836 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581983.919103:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788581983.919109:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d86671050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:3306:x1875464020847616:12345-0@lo:103: 00010000:00010000:0.0:1788581983.919118:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788581983.919123:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d80030a00/0x2bc3aa892c3a6ab9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6ab2 expref: 13 pid: 5836 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.919132:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d80030a00/0x2bc3aa892c3a6ab9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6ab2 expref: 13 pid: 5836 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.919143:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d80030a00/0x2bc3aa892c3a6ab9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a6ab2 expref: 13 pid: 5836 timeout: 352 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.919161:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d0d88e27a00/0x2bc3aa892c3a6b92 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.919169:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d88e27a00/0x2bc3aa892c3a6b92 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.919183:0:5830:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0d88e27a00/0x2bc3aa892c3a6b92 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.919190:0:5830:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0d88e27a00/0x2bc3aa892c3a6b92 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.919197:0:5830:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d0d88e27a00/0x2bc3aa892c3a6b92 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.919230:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d0d88e27a00/0x2bc3aa892c3a6b92 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.919236:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27a00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:0.0:1788581983.919240:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d0d88e27a00/0x2bc3aa892c3a6b92 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.919247:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d0d88e27a00/0x2bc3aa892c3a6b92 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.919265:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d0d88e27a00/0x2bc3aa892c3a6b92 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.919489:0:8453:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d0d88e27a00/0x2bc3aa892c3a6b92 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581983.919498:0:8453:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d0d88e27a00/0x2bc3aa892c3a6b92 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.920618:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d88e27a00/0x2bc3aa892c3a6b92 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8453 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581983.920652:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788581983.920724:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d86671050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:3306:x1875464020847616:12345-0@lo:103: Request processed in 1612us (2124us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581983.920733:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788581983.920875:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020847616:0@lo:103: 00010000:00010000:0.0:1788581983.981434:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581984.282402:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788581984.282538:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001949952 00000100:00100000:3.0:1788581984.282550:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001949952 00000100:00100000:3.0:1788581984.282611:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 131 00000100:00100000:3.0:1788581984.282623:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+8:5589:x1875464001949952:12345-192.168.201.12@tcp:101: 00010000:00010000:3.0:1788581984.282644:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581984.282678:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a6b99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c900d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581984.282707:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a6b99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c900d expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581984.282719:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a6b99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c900d expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581984.282742:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27000, rc 0) 00000100:00100000:3.0:1788581984.282806:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+9:5589:x1875464001949952:12345-192.168.201.12@tcp:101: Request processed in 185us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581984.282813:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 131 00000100:00100000:2.0:1788581984.291840:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788581984.292672:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001950080 00000100:00100000:1.0:1788581984.292684:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001950080 00000100:00100000:1.0:1788581984.292744:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 132 00000100:00100000:1.0:1788581984.292756:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+9:5589:x1875464001950080:12345-192.168.201.12@tcp:501: 00000100:00100000:1.0:1788581984.293070:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+9:5589:x1875464001950080:12345-192.168.201.12@tcp:501: Request processed in 317us (1240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581984.293079:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 132 00000100:00100000:1.0:1788581984.308368:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788581984.308507:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001950208 00000100:00100000:2.0:1788581984.308516:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001950208 00000100:00100000:2.0:1788581984.308567:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 133 00000100:00100000:2.0:1788581984.308576:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+9:5589:x1875464001950208:12345-192.168.201.12@tcp:503: 00000100:00100000:2.0:1788581984.308805:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+9:5589:x1875464001950208:12345-192.168.201.12@tcp:503: Request processed in 229us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581984.308813:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 133 00000100:00100000:1.0:1788581984.316111:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788581984.316365:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001950336 00000100:00100000:2.0:1788581984.316376:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001950336 00000100:00100000:2.0:1788581984.316449:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 134 00000100:00100000:2.0:1788581984.316459:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+9:6056:x1875464001950336:12345-192.168.201.12@tcp:502: 00000100:00100000:2.0:1788581984.316917:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+9:6056:x1875464001950336:12345-192.168.201.12@tcp:502: Request processed in 458us (814us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581984.316926:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 134 00000100:00100000:3.0:1788581984.332047:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788581984.332153:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001950464 00000100:00100000:1.0:1788581984.332163:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001950464 00000100:00100000:1.0:1788581984.332249:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 135 00000100:00100000:1.0:1788581984.332261:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+9:6056:x1875464001950464:12345-192.168.201.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788581984.332743:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+9:6056:x1875464001950464:12345-192.168.201.12@tcp:502:llog_process_th.0 Request processed in 406us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581984.332753:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 135 00000100:00100000:1.0:1788581984.335587:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788581984.335688:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001950592 00000100:00100000:2.0:1788581984.335698:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001950592 00000100:00100000:2.0:1788581984.335753:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 136 00000100:00100000:2.0:1788581984.335763:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+9:5589:x1875464001950592:12345-192.168.201.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581984.335793:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581984.335812:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8138e000/0x2bc3aa892c3a6ba0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9014 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581984.335840:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8138e000/0x2bc3aa892c3a6ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9014 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581984.335851:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8138e000/0x2bc3aa892c3a6ba0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9014 expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581984.335860:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8138e000, rc 0) 00000100:00100000:2.0:1788581984.335929:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:5589:x1875464001950592:12345-192.168.201.12@tcp:101:ll_cfg_requeue.0 Request processed in 167us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581984.335936:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 136 00000100:00100000:2.0:1788581984.342122:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788581984.346835:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001950720 00000100:00100000:0.0:1788581984.346851:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001950720 00000100:00100000:0.0:1788581984.346938:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 137 00000100:00100000:0.0:1788581984.346950:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:5589:x1875464001950720:12345-192.168.201.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581984.347306:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:5589:x1875464001950720:12345-192.168.201.12@tcp:501:ll_cfg_requeue.0 Request processed in 357us (5190us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788581984.347314:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 137 00010000:00010000:0.0:1788581985.006751:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788581985.123317:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788581985.123356:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788581985.123398:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788581985.123446:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788581985.123560:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001950976 00000100:00100000:2.0:1788581985.123571:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001950976 00000100:00100000:2.0:1788581985.123639:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 25 00000100:00100000:2.0:1788581985.123649:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+6:2352:x1875464001950976:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788581985.123743:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d11880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+6:2352:x1875464001950976:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 94us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581985.123750:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 25 00000100:00100000:1.0:1788581985.124343:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001951104 00000100:00100000:1.0:1788581985.124348:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001951104 00000100:00100000:1.0:1788581985.124397:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001951232 00000100:00100000:1.0:1788581985.124400:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001951232 00000100:00100000:1.0:1788581985.124433:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 11 00000100:00100000:1.0:1788581985.124442:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+5:2352:x1875464001951104:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788581985.124505:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+5:2352:x1875464001951104:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 66us (1149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581985.124512:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 11 00000100:00100000:1.0:1788581985.124528:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 12 00000100:00100000:1.0:1788581985.124534:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+5:2352:x1875464001951232:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788581985.124558:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+5:2352:x1875464001951232:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 25us (1112us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581985.124564:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 12 00000100:00080000:3.0:1788581985.125113:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788581985.125118:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788581985.125120:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581985.125320:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001950848 00000100:00100000:0.0:1788581985.125326:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001950848 00000100:00100000:0.0:1788581985.125378:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 138 00000100:00100000:0.0:1788581985.125386:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2352:x1875464001950848:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788581985.125444:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2352:x1875464001950848:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 58us (2136us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581985.125450:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 138 00000100:00100000:1.0:1788581985.262406:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788581985.262437:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020847872:0@lo:13: 00000100:00100000:1.0:1788581985.262514:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581985.263051:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020847872 00000100:00100000:2.0:1788581985.263060:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020847872 00000100:00100000:2.0:1788581985.263126:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788581985.263136:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020847872:12345-0@lo:13: 00002000:00000024:2.0:1788581985.263170:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581985.263268:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020847872:12345-0@lo:13: Request processed in 132us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581985.263276:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1788581985.263376:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788581985.263704:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0d9dd97100 x1875464020847872/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582001 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581985.263731:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020847872:0@lo:13: 10000000:01000000:2.0:1788581985.903921:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788581985.903929:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0dbf4ee800 from 39 10000000:01000000:2.0:1788581985.903934:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788581985.903986:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6ba7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581985.903999:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6ba7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581985.904011:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6ba7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581985.904037:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd94a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020848000:0@lo:101: 00000100:00100000:2.0:1788581985.904109:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581985.904165:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c3cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581985.904677:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020848000 00000100:00100000:3.0:1788581985.904697:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020848000 00000100:00100000:3.0:1788581985.904755:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788581985.904766:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+12:5840:x1875464020848000:12345-0@lo:101: 00010000:00010000:3.0:1788581985.904783:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581985.904798:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d88e26600/0x2bc3aa892c3a6bae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6ba7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581985.904824:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d88e26600/0x2bc3aa892c3a6bae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6ba7 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581985.904833:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d88e26600/0x2bc3aa892c3a6bae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6ba7 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581985.904842:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26600, rc 0) 00000100:00100000:3.0:1788581985.904916:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:5840:x1875464020848000:12345-0@lo:101: Request processed in 152us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581985.904923:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788581985.907185:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd94a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020848000:0@lo:101: 00010000:00010000:2.0:1788581985.907230:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6ba7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6bae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581985.907244:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6ba7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6bae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581985.907327:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd94a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020848128:0@lo:501: 00000100:00100000:2.0:1788581985.907409:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581985.907463:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581985.910017:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020848128 00000100:00100000:0.0:1788581985.910032:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020848128 00000100:00100000:0.0:1788581985.910088:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788581985.910099:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:5840:x1875464020848128:12345-0@lo:501: 00000100:00100000:0.0:1788581985.910615:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:5840:x1875464020848128:12345-0@lo:501: Request processed in 515us (3205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581985.911323:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd94a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020848128:0@lo:501: 00000100:00100000:2.0:1788581985.911377:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd94a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020848256:0@lo:503: 00000100:00100000:2.0:1788581985.911424:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581985.911457:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c3cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581985.912122:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788581985.913763:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020848256 00000100:00100000:0.0:1788581985.913776:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020848256 00000100:00100000:0.0:1788581985.913819:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788581985.913828:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:5840:x1875464020848256:12345-0@lo:503: 00000100:00100000:0.0:1788581985.917579:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:5840:x1875464020848256:12345-0@lo:503: Request processed in 3741us (6143us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581985.917596:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788581985.917607:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd94a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020848256:0@lo:503: 00000100:00100000:0.0:1788581985.921151:0:8492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd92d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8492:1875464020848384:0@lo:502: 00000100:00100000:1.0:1788581985.921445:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581985.921498:0:8492:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da79dcd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581985.921562:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020848384 00000100:00100000:0.0:1788581985.921570:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020848384 00000100:00100000:0.0:1788581985.921621:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788581985.921633:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:8492:x1875464020848384:12345-0@lo:502: 00000100:00100000:0.0:1788581985.922066:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:8492:x1875464020848384:12345-0@lo:502: Request processed in 434us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581985.922074:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788581985.927528:0:8492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd92d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8492:1875464020848384:0@lo:502: 00000100:00100000:1.0:1788581985.927618:0:8492:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8492:1875464020848512:0@lo:502: 00000100:00100000:1.0:1788581985.927689:0:8492:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581985.927738:0:8492:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbfd6f840 going to sleep for 11 seconds 00000100:00100000:0.0:1788581985.927820:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020848512 00000100:00100000:0.0:1788581985.927829:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020848512 00000100:00100000:0.0:1788581985.927892:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788581985.927902:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3330850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:8492:x1875464020848512:12345-0@lo:502: 00000100:00100000:0.0:1788581985.928168:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3330850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:8492:x1875464020848512:12345-0@lo:502: Request processed in 266us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581985.928177:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788581985.929333:0:8492:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8492:1875464020848512:0@lo:502: 00000040:00080000:2.0:1788581985.929372:0:8492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788581985.930423:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788581985.930451:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788581985.930461:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6ba7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6bae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581985.930474:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6bae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581985.930483:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:3.0:1788581985.930486:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:3.0:1788581985.930489:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788581985.930525:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27e00/0x2bc3aa892c3a6bb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581985.930534:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27e00/0x2bc3aa892c3a6bb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581985.930545:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27e00/0x2bc3aa892c3a6bb5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581985.930568:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020848640:0@lo:101: 00000100:00100000:3.0:1788581985.930630:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581985.930674:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c82b94240 going to sleep for 11 seconds 00000100:00100000:1.0:1788581985.932094:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020848640 00000100:00100000:1.0:1788581985.932107:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020848640 00000100:00100000:1.0:1788581985.932164:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788581985.932183:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3331850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+13:5840:x1875464020848640:12345-0@lo:101: 00010000:00010000:1.0:1788581985.932222:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581985.932299:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8167d200/0x2bc3aa892c3a6bbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6bb5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581985.932328:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8167d200/0x2bc3aa892c3a6bbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6bb5 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581985.932339:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8167d200/0x2bc3aa892c3a6bbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6bb5 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581985.932348:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8167d200, rc 0) 00000100:00100000:1.0:1788581985.932413:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3331850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:5840:x1875464020848640:12345-0@lo:101: Request processed in 233us (1782us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581985.932421:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788581985.936082:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020848640:0@lo:101: 00010000:00010000:3.0:1788581985.936115:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27e00/0x2bc3aa892c3a6bb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6bbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581985.936140:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27e00/0x2bc3aa892c3a6bb5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6bbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581985.936231:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020848768:0@lo:501: 00000100:00100000:3.0:1788581985.936302:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581985.936332:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020848768 00000100:00100000:2.0:1788581985.936339:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020848768 00000100:00100000:2.0:1788581985.936392:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788581985.936402:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:5840:x1875464020848768:12345-0@lo:501: 00000100:00100000:2.0:1788581985.936683:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:5840:x1875464020848768:12345-0@lo:501: Request processed in 282us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581985.936692:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788581985.936736:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c82b94240 going to sleep for 11 seconds 00000100:00100000:2.0:1788581985.936749:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d12d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020848768:0@lo:501: 00000100:00100000:2.0:1788581985.936781:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd95880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020848896:0@lo:503: 00000100:00100000:2.0:1788581985.936819:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581985.936831:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c3a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788581985.937037:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020848896 00000100:00100000:0.0:1788581985.937043:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020848896 00000100:00100000:0.0:1788581985.937073:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788581985.937086:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:5840:x1875464020848896:12345-0@lo:503: 00000100:00100000:0.0:1788581985.937290:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:5840:x1875464020848896:12345-0@lo:503: Request processed in 198us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581985.937297:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788581985.937333:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd95880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020848896:0@lo:503: 00000100:00100000:0.0:1788581985.937544:0:8496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8496:1875464020849024:0@lo:502: 00000100:00100000:0.0:1788581985.937577:0:8496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581985.937595:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020849024 00000100:00100000:0.0:1788581985.937598:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020849024 00000100:00100000:0.0:1788581985.937614:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788581985.937620:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3330c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:8496:x1875464020849024:12345-0@lo:502: 00000100:00100000:0.0:1788581985.937733:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3330c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:8496:x1875464020849024:12345-0@lo:502: Request processed in 113us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581985.937739:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788581985.937761:0:8496:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d84ec8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581985.937772:0:8496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8496:1875464020849024:0@lo:502: 00000020:01000000:0.0:1788581985.937794:0:8496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581985.937802:0:8496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581985.937805:0:8496:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788581985.937810:0:8496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788581985.937832:0:8496:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8496:1875464020849152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581985.937882:0:8496:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581985.937917:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020849152 00000100:00100000:0.0:1788581985.937921:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020849152 00000100:00100000:2.0:1788581985.937949:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788581985.937958:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3331050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:8496:x1875464020849152:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581985.938116:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3331050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:8496:x1875464020849152:12345-0@lo:502:llog_process_th.0 Request processed in 159us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581985.938663:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788581985.938673:0:8496:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d84ec8180 going to sleep for 11 seconds 00000100:00100000:0.0:1788581985.938693:0:8496:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd90000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8496:1875464020849152:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788581985.938727:0:8496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581985.938732:0:8496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581985.938734:0:8496:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788581985.938738:0:8496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788581985.938819:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788581985.938840:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788581985.938860:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27e00/0x2bc3aa892c3a6bb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6bbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581985.938878:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27e00/0x2bc3aa892c3a6bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6bbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788581985.938888:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788581985.938891:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0dac39a800 from 39 10000000:01000000:2.0:1788581985.938894:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788581985.938922:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fc00/0x2bc3aa892c3a6bc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581985.938930:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fc00/0x2bc3aa892c3a6bc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581985.938939:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fc00/0x2bc3aa892c3a6bc3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581985.938955:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd97b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020849280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788581985.938989:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581985.939016:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c30c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788581985.940029:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020849280 00000100:00100000:3.0:1788581985.940037:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020849280 00000100:00100000:3.0:1788581985.940089:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788581985.940099:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:5840:x1875464020849280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581985.940114:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788581985.940130:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d88e26a00/0x2bc3aa892c3a6bca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6bc3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581985.940155:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d88e26a00/0x2bc3aa892c3a6bca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6bc3 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581985.940166:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d88e26a00/0x2bc3aa892c3a6bca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6bc3 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581985.940176:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26a00, rc 0) 00000100:00100000:3.0:1788581985.940321:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:5840:x1875464020849280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 223us (1330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581985.940329:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788581985.940336:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd97b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020849280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581985.940354:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fc00/0x2bc3aa892c3a6bc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6bca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581985.940363:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fc00/0x2bc3aa892c3a6bc3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6bca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581985.940412:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd97b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020849408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581985.940439:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581985.940478:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581985.940491:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020849408 00000100:00100000:0.0:1788581985.940496:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020849408 00000100:00100000:0.0:1788581985.940527:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788581985.940535:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3331450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:5840:x1875464020849408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581985.940771:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3331450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:5840:x1875464020849408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 237us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581985.940780:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788581985.940796:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd97b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020849408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581985.940822:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd97b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020849536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581985.940867:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581985.940887:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581985.940997:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020849536 00000100:00100000:0.0:1788581985.941001:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020849536 00000100:00100000:0.0:1788581985.941031:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788581985.941039:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:5840:x1875464020849536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581985.941181:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:5840:x1875464020849536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581985.941188:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788581985.941296:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd97b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020849536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581985.941601:0:8497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd97b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8497:1875464020849664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581985.941642:0:8497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581985.941666:0:8497:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581985.941761:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020849664 00000100:00100000:0.0:1788581985.941769:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020849664 00000100:00100000:0.0:1788581985.941804:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788581985.941815:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:8497:x1875464020849664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581985.941989:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:8497:x1875464020849664:12345-0@lo:502:llog_process_th.0 Request processed in 178us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581985.941995:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788581985.943501:0:8497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd97b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8497:1875464020849664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581985.943566:0:8497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd97b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8497:1875464020849792:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581985.943628:0:8497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581985.943775:0:8497:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c36c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581985.945529:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020849792 00000100:00100000:0.0:1788581985.945542:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020849792 00000100:00100000:0.0:1788581985.945752:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788581985.945764:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:8497:x1875464020849792:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581985.947755:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:8497:x1875464020849792:12345-0@lo:502:llog_process_th.0 Request processed in 1987us (4120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581985.947768:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788581985.948126:0:8497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd97b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8497:1875464020849792:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788581985.948375:0:8497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788581985.948947:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1788581985.948967:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788581985.948978:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fc00/0x2bc3aa892c3a6bc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6bca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581985.948989:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fc00/0x2bc3aa892c3a6bc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6bca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581985.948999:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788581985.949002:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788581985.949006:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788581985.949038:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7089400/0x2bc3aa892c3a6bd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581985.949047:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0da7089400/0x2bc3aa892c3a6bd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581985.949058:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0da7089400/0x2bc3aa892c3a6bd1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581985.949080:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020849920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788581985.949127:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581985.949251:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d92363cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581985.949626:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020849920 00000100:00100000:2.0:1788581985.949634:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020849920 00000100:00100000:2.0:1788581985.950939:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788581985.950952:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3333450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:5840:x1875464020849920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581985.950971:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581985.950988:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8138f200/0x2bc3aa892c3a6bd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6bd1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581985.951015:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8138f200/0x2bc3aa892c3a6bd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6bd1 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581985.951040:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8138f200/0x2bc3aa892c3a6bd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6bd1 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581985.951048:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8138f200, rc 0) 00000100:00100000:2.0:1788581985.951117:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3333450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:5840:x1875464020849920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (1989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581985.951124:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788581985.951186:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020849920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581985.951416:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0da7089400/0x2bc3aa892c3a6bd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6bd8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581985.951425:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0da7089400/0x2bc3aa892c3a6bd1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6bd8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581985.951493:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020850048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581985.951528:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581985.951643:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbfd6f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788581985.951747:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020850048 00000100:00100000:0.0:1788581985.951753:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020850048 00000100:00100000:0.0:1788581985.951790:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788581985.951798:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:5840:x1875464020850048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581985.952155:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:5840:x1875464020850048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 348us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581985.952164:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788581985.952360:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020850048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581985.952393:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020850176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581985.952437:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581985.952710:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbfd6f780 going to sleep for 11 seconds 00000100:00100000:0.0:1788581985.952795:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020850176 00000100:00100000:0.0:1788581985.952800:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020850176 00000100:00100000:0.0:1788581985.952840:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788581985.952848:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:5840:x1875464020850176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581985.953417:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:5840:x1875464020850176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 569us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581985.953425:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788581985.953662:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020850176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581985.963073:0:8500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8500:1875464020850304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581985.963762:0:8500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581985.964172:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020850304 00000100:00100000:0.0:1788581985.964180:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020850304 00000100:00100000:0.0:1788581985.964254:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788581985.964265:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3332c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:8500:x1875464020850304:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581985.964503:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3332c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:8500:x1875464020850304:12345-0@lo:502:llog_process_th.0 Request processed in 240us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581985.964511:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1788581985.983037:0:8500:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbfd6f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788581985.983084:0:8500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8500:1875464020850304:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788581985.983127:0:8500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581985.983139:0:8500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581985.983142:0:8500:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788581985.983148:0:8500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788581985.983185:0:8500:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8500:1875464020850432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581985.983279:0:8500:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581985.983308:0:8500:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbfd6f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788581985.985998:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020850432 00000100:00100000:0.0:1788581985.986012:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020850432 00000100:00100000:0.0:1788581985.986068:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788581985.986080:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:8500:x1875464020850432:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581985.986400:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:8500:x1875464020850432:12345-0@lo:502:llog_process_th.0 Request processed in 322us (3121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581985.986409:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788581985.986415:0:8500:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8500:1875464020850432:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788581985.986458:0:8500:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581985.986467:0:8500:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581985.986469:0:8500:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788581985.986475:0:8500:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788581985.986751:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788581985.986770:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788581985.986784:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7089400/0x2bc3aa892c3a6bd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6bd8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581985.986795:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0da7089400/0x2bc3aa892c3a6bd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6bd8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581985.986804:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788581985.986806:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0d945e5800 from 39 10000000:01000000:0.0:1788581985.986809:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788581985.986836:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7089200/0x2bc3aa892c3a6bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581985.986844:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0da7089200/0x2bc3aa892c3a6bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581985.986865:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0da7089200/0x2bc3aa892c3a6bdf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581985.986885:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020850560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788581985.986918:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581985.986945:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d97efd300 going to sleep for 11 seconds 00000100:00100000:1.0:1788581985.987086:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020850560 00000100:00100000:1.0:1788581985.987091:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020850560 00000100:00100000:1.0:1788581985.987121:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788581985.987129:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:5840:x1875464020850560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581985.987138:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581985.987155:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8167c600/0x2bc3aa892c3a6be6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6bdf expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581985.987175:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8167c600/0x2bc3aa892c3a6be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6bdf expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581985.987184:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8167c600/0x2bc3aa892c3a6be6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6bdf expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581985.987192:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8167c600, rc 0) 00000100:00100000:1.0:1788581985.987243:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020850560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581985.987249:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788581985.987282:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd91500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020850560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581985.987294:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0da7089200/0x2bc3aa892c3a6bdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6be6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581985.987303:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0da7089200/0x2bc3aa892c3a6bdf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6be6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581985.987343:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020850688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581985.987371:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581985.987385:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbfd6fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788581985.987396:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020850688 00000100:00100000:1.0:1788581985.987400:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020850688 00000100:00100000:1.0:1788581985.987420:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788581985.987425:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020850688:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581985.987908:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020850688:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 412us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581985.987920:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788581985.987953:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020850688:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581985.987978:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020850816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581985.988013:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581985.988027:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbfd6fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788581985.988038:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020850816 00000100:00100000:1.0:1788581985.988041:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020850816 00000100:00100000:1.0:1788581985.988063:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788581985.988069:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020850816:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581985.988198:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020850816:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581985.988223:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788581985.988259:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020850816:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581985.990082:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd97b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8506:1875464020850944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581985.990151:0:8506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581985.990345:0:8506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c3900 going to sleep for 11 seconds 00000100:00100000:3.0:1788581985.990616:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020850944 00000100:00100000:3.0:1788581985.990623:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020850944 00000100:00100000:3.0:1788581985.990706:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788581985.990716:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:8506:x1875464020850944:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581985.991904:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:8506:x1875464020850944:12345-0@lo:502:llog_process_th.0 Request processed in 1185us (1747us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581985.991917:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1788581985.992513:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd97b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8506:1875464020850944:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581985.992600:0:8506:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd97b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8506:1875464020851072:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581985.992649:0:8506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581985.992716:0:8506:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c3e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581985.997183:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020851072 00000100:00100000:3.0:1788581985.997420:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020851072 00000100:00100000:3.0:1788581985.999412:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788581985.999428:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:8506:x1875464020851072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581985.999734:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:8506:x1875464020851072:12345-0@lo:502:llog_process_th.0 Request processed in 310us (7084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581985.999743:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788581986.000019:0:8506:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd97b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8506:1875464020851072:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788581986.001162:0:8506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788581986.001490:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788581986.001519:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788581986.001533:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7089200/0x2bc3aa892c3a6bdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6be6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581986.001548:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0da7089200/0x2bc3aa892c3a6bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6be6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581986.001561:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788581986.001564:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788581986.001567:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788581986.001616:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a6bed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581986.001625:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a6bed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581986.001636:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a6bed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581986.001673:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020851200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788581986.001741:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581986.001789:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c82b94e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788581986.001950:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020851200 00000100:00100000:2.0:1788581986.001957:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020851200 00000100:00100000:2.0:1788581986.002008:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788581986.002018:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020851200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581986.002031:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581986.002046:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8138e600/0x2bc3aa892c3a6bf4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6bed expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581986.002166:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8138e600/0x2bc3aa892c3a6bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6bed expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581986.002185:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8138e600/0x2bc3aa892c3a6bf4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6bed expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581986.002194:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8138e600, rc 0) 00000100:00100000:2.0:1788581986.002277:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020851200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 260us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581986.002284:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788581986.003390:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020851200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788581986.003414:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a6bed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6bf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581986.003424:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a6bed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6bf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581986.003490:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020851328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581986.003528:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581986.003560:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c82b94e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581986.003577:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020851328 00000100:00100000:3.0:1788581986.003582:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020851328 00000100:00100000:3.0:1788581986.003615:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788581986.003622:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020851328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581986.003906:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020851328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581986.003913:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788581986.003946:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020851328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788581986.003974:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020851456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581986.004017:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581986.004032:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c82b94e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788581986.004052:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020851456 00000100:00100000:3.0:1788581986.004057:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020851456 00000100:00100000:3.0:1788581986.004075:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1788581986.004082:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020851456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581986.004257:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020851456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581986.004955:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d11180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020851456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581986.005138:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788581986.006873:0:8509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd97b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8509:1875464020851584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581986.006942:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581986.006984:0:8509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c3240 going to sleep for 11 seconds 00000100:00100000:3.0:1788581986.007039:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020851584 00000100:00100000:3.0:1788581986.007046:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020851584 00000100:00100000:3.0:1788581986.007099:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788581986.007109:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:8509:x1875464020851584:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581986.007558:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:8509:x1875464020851584:12345-0@lo:502:llog_process_th.0 Request processed in 450us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581986.007566:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788581986.007958:0:8509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd97b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8509:1875464020851584:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788581986.007989:0:8509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581986.007998:0:8509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581986.008001:0:8509:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788581986.008008:0:8509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788581986.008034:0:8509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8509:1875464020851712:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581986.008076:0:8509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581986.008112:0:8509:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbfd6f780 going to sleep for 11 seconds 00000100:00100000:3.0:1788581986.009924:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020851712 00000100:00100000:3.0:1788581986.009936:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020851712 00000100:00100000:3.0:1788581986.009986:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788581986.009997:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:8509:x1875464020851712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581986.010300:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:8509:x1875464020851712:12345-0@lo:502:llog_process_th.0 Request processed in 304us (2222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581986.010308:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788581986.011306:0:8509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8509:1875464020851712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788581986.011347:0:8509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788581986.011354:0:8509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788581986.011356:0:8509:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788581986.011361:0:8509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788581986.011568:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1788581986.011586:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788581986.011597:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a6bed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6bf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581986.011607:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a6bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6bf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788581986.011624:0:5840:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788581986.011627:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d0d9dde8000 from 1 10000000:01000000:3.0:1788581986.011630:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788581986.011660:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26e00/0x2bc3aa892c3a6bfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581986.011668:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26e00/0x2bc3aa892c3a6bfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788581986.011677:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26e00/0x2bc3aa892c3a6bfb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581986.011698:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d11f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020851840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788581986.013017:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581986.013069:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c82b940c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581986.013120:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020851840 00000100:00100000:2.0:1788581986.013128:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020851840 00000100:00100000:2.0:1788581986.013177:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788581986.013187:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020851840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581986.013223:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581986.013248:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8138fa00/0x2bc3aa892c3a6c02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6bfb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581986.013273:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8138fa00/0x2bc3aa892c3a6c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6bfb expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581986.013285:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8138fa00/0x2bc3aa892c3a6c02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6bfb expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581986.013301:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8138fa00, rc 0) 00000100:00100000:2.0:1788581986.013350:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020851840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 164us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581986.013356:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788581986.013493:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d11f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020851840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581986.013510:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26e00/0x2bc3aa892c3a6bfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6c02 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.013520:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26e00/0x2bc3aa892c3a6bfb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6c02 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581986.013585:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd91c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020851968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581986.013623:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581986.013644:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d97efd780 going to sleep for 11 seconds 00000100:00100000:0.0:1788581986.013658:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020851968 00000100:00100000:0.0:1788581986.013661:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020851968 00000100:00100000:0.0:1788581986.013683:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788581986.013689:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020851968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581986.013925:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020851968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (300us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788581986.013934:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1788581986.013967:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd91c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020851968:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788581986.013994:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788581986.014001:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26e00/0x2bc3aa892c3a6bfb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6c02 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.014008:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26e00/0x2bc3aa892c3a6bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6c02 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.030406:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788581986.036588:0:8511:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc4410e9c0 20000000:00000080:0.0:1788581986.036609:0:8511:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d0d85a37000 uarg=0000000000000000 20000000:01000000:0.0:1788581986.036647:0:8511:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788581986.036653:0:8511:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788581986.036657:0:8511:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788581986.041085:0:8512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:0.0:1788581986.041367:0:8511:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:0.0:1788581986.047817:0:8511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:0.0:1788581986.047882:0:8511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:0.0:1788581986.047930:0:8511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:0.0:1788581986.047945:0:8511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788581986.047962:0:8511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d0da7088800/0x2bc3aa892c3a6c09 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.047984:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d80031200/0x2bc3aa892c3a697e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6977 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.047991:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d88e26800/0x2bc3aa892c3a69e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a69d9 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.047997:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d8138fe00/0x2bc3aa892c3a6aab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6aa4 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.048007:0:8511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0da7089e00/0x2bc3aa892c3a6b68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fdc expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.048013:0:8511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d0da7088800/0x2bc3aa892c3a6c09 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.048048:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0da7089e00/0x2bc3aa892c3a6b68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fdc expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.048669:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d0da7089e00/0x2bc3aa892c3a6b68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fdc expref: 9 pid: 5837 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581986.048687:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd91c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875464020852096:192.168.201.12@tcp:104: 00010000:00010000:0.0:1788581986.048790:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d8138fe00/0x2bc3aa892c3a6aab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a6aa4 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.048798:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d8138fe00/0x2bc3aa892c3a6aab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6aa4 expref: 18 pid: 5836 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581986.048807:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd93100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875464020852224:0@lo:104: 00000100:00100000:0.0:1788581986.048912:0:8511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788581986.048946:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d88e26800/0x2bc3aa892c3a69e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a69d9 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.048954:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d88e26800/0x2bc3aa892c3a69e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a69d9 expref: 18 pid: 5836 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581986.048962:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd93480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875464020852352:0@lo:104: 00000100:00100000:0.0:1788581986.048985:0:8511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581986.049022:0:5826:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788581986.049034:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020852224 00000100:00100000:0.0:1788581986.049040:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020852224 00000100:00100000:0.0:1788581986.049089:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020852352 00000100:00100000:0.0:1788581986.049092:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020852352 00000100:00100000:0.0:1788581986.049108:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788581986.049117:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+4:8511:x1875464020852224:12345-0@lo:104: 00010000:00010000:0.0:1788581986.049129:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a6aa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6aab expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.049183:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581986.049188:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+4:8511:x1875464020852224:12345-0@lo:104: Request processed in 73us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581986.049194:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788581986.049314:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788581986.049321:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc71850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:8511:x1875464020852352:12345-0@lo:104: 00010000:00010000:0.0:1788581986.049328:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26c00/0x2bc3aa892c3a69d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a69e0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.049361:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788581986.049372:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc71850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:8511:x1875464020852352:12345-0@lo:104: Request processed in 52us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581986.049378:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1788581986.049414:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788581986.049420:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a6aa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6aab expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.049427:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27800 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:0.0:1788581986.049431:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a6aa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a6aab expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.049439:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a6aa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a6aab expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581986.049446:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a6aa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a6aab expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581986.049451:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788581986.049477:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a6aa4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6aab expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.049484:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581986.049501:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a6aa4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6aab expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.049508:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27800/0x2bc3aa892c3a6aa4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6aab expref: -99 pid: 7630 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.049519:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788581986.049522:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26c00/0x2bc3aa892c3a69d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a69e0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.049537:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26c00 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:0.0:1788581986.049540:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26c00/0x2bc3aa892c3a69d9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a69e0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.049547:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26c00/0x2bc3aa892c3a69d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a69e0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788581986.049553:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26c00/0x2bc3aa892c3a69d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a69e0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581986.049557:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788581986.049570:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26c00/0x2bc3aa892c3a69d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a69e0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.049576:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788581986.049589:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26c00/0x2bc3aa892c3a69d9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a69e0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.049594:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26c00/0x2bc3aa892c3a69d9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a69e0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.049602:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581986.049604:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581986.049606:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788581986.049614:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581986.049626:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788581986.049637:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020852480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581986.049663:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788581986.049701:0:8511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d80031200/0x2bc3aa892c3a697e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a6977 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.049714:0:8511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d80031200/0x2bc3aa892c3a697e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6977 expref: 18 pid: 5838 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581986.049723:0:8511:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd91f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875464020852736:0@lo:104: 00000100:00100000:0.0:1788581986.049744:0:8511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581986.049761:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020852736 00000100:00100000:0.0:1788581986.049765:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020852736 00000100:00100000:0.0:1788581986.049782:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788581986.049910:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:8511:x1875464020852736:12345-0@lo:104: 00010000:00010000:0.0:1788581986.049922:0:5826:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f400/0x2bc3aa892c3a6977 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a697e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.049953:0:5826:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788581986.049958:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd92680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:8511:x1875464020852736:12345-0@lo:104: Request processed in 171us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581986.049963:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788581986.049984:0:8511:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d97efd780 going to sleep for 11 seconds 00000100:00100000:0.0:1788581986.050003:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd93100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875464020852224:0@lo:104: 00000100:00100000:0.0:1788581986.050013:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd93480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875464020852352:0@lo:104: 00000100:00100000:0.0:1788581986.050019:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd91f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875464020852736:0@lo:104: 00000100:00100000:1.0:1788581986.050103:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581986.050119:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020852608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581986.050146:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581986.050182:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020852480 00000100:00100000:1.0:1788581986.050186:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020852480 00010000:00010000:1.0:1788581986.050229:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d8138fe00/0x2bc3aa892c3a6aab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6aa4 expref: 19 pid: 5836 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581986.050258:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020852608 00000100:00100000:1.0:1788581986.050261:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020852608 00010000:00010000:1.0:1788581986.050274:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d88e26800/0x2bc3aa892c3a69e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a69d9 expref: 20 pid: 5836 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581986.050294:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788581986.050301:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+20:3308:x1875464020852480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581986.050313:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581986.050319:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d8138fe00/0x2bc3aa892c3a6aab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6aa4 expref: 20 pid: 5836 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.050327:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d8138fe00/0x2bc3aa892c3a6aab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6aa4 expref: 20 pid: 5836 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.050346:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8138fe00/0x2bc3aa892c3a6aab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a6aa4 expref: 20 pid: 5836 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.050357:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581986.050387:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020852480:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (722us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581986.050393:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788581986.050406:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788581986.050411:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:3307:x1875464020852608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581986.050424:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581986.050429:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d88e26800/0x2bc3aa892c3a69e0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a69d9 expref: 18 pid: 5836 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.050436:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d88e26800/0x2bc3aa892c3a69e0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a69d9 expref: 18 pid: 5836 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.050444:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d88e26800/0x2bc3aa892c3a69e0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a69d9 expref: 18 pid: 5836 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.050452:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581986.050476:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:3307:x1875464020852608:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581986.050482:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788581986.050509:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020852480:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581986.050525:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788581986.050537:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f400/0x2bc3aa892c3a6977 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a697e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.050544:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8138f400 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:1.0:1788581986.050547:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f400/0x2bc3aa892c3a6977 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a697e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.050554:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f400/0x2bc3aa892c3a6977 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a697e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788581986.050561:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f400/0x2bc3aa892c3a6977 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a697e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581986.050577:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788581986.050597:0:7637:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f400/0x2bc3aa892c3a6977 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a697e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.050604:0:7637:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788581986.050611:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f400/0x2bc3aa892c3a6977 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a697e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.050617:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d8138f400/0x2bc3aa892c3a6977 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a697e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.050629:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581986.050631:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581986.050633:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581986.050644:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020852864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581986.050667:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581986.050687:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020852608:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788581986.050718:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020852864 00000100:00100000:1.0:1788581986.050722:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020852864 00010000:00010000:1.0:1788581986.050734:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d80031200/0x2bc3aa892c3a697e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6977 expref: 17 pid: 5838 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581986.050751:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788581986.050757:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:3307:x1875464020852864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788581986.050764:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581986.050767:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d80031200/0x2bc3aa892c3a697e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6977 expref: 17 pid: 5838 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.050785:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d80031200/0x2bc3aa892c3a697e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6977 expref: 17 pid: 5838 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.050794:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d80031200/0x2bc3aa892c3a697e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a6977 expref: 17 pid: 5838 timeout: 355 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.050803:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788581986.050831:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:3307:x1875464020852864:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581986.050838:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788581986.050877:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020852864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788581986.071320:0:8511:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd91c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8511:1875464020852096:192.168.201.12@tcp:104: 00010000:00010000:0.0:1788581986.071360:0:8511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d0da7088800/0x2bc3aa892c3a6c09 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788581986.071732:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788581986.072332:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001951360 00000100:00100000:1.0:1788581986.072341:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001951360 00010000:00010000:1.0:1788581986.072384:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0da7089e00/0x2bc3aa892c3a6b68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fdc expref: 10 pid: 5837 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581986.072429:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 24 00000100:00100000:1.0:1788581986.072439:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2349:x1875464001951360:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788581986.072455:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788581986.072462:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0da7089e00/0x2bc3aa892c3a6b68 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fdc expref: 10 pid: 5837 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.072474:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0da7089e00/0x2bc3aa892c3a6b68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fdc expref: 10 pid: 5837 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.072491:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0da7089e00/0x2bc3aa892c3a6b68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fdc expref: 10 pid: 5837 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.072531:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d0da7088800/0x2bc3aa892c3a6c09 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.072541:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0da7088800/0x2bc3aa892c3a6c09 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.072554:0:7636:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0da7088800/0x2bc3aa892c3a6c09 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.072562:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0da7088800/0x2bc3aa892c3a6c09 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.072569:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d0da7088800/0x2bc3aa892c3a6c09 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.072576:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d0da7088800/0x2bc3aa892c3a6c09 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.072582:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088800 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788581986.072586:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d0da7088800/0x2bc3aa892c3a6c09 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.072593:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d0da7088800/0x2bc3aa892c3a6c09 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.072611:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d0da7088800/0x2bc3aa892c3a6c09 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581986.072620:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788581986.072645:0:8511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d0da7088800/0x2bc3aa892c3a6c09 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.072666:0:8511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d0da7088800/0x2bc3aa892c3a6c09 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581986.072674:0:8511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0da7088800/0x2bc3aa892c3a6c09 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581986.072695:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:05a4b000-bb80-4acb-83cf-d9c3916564a8+9:2349:x1875464001951360:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 255us (963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581986.072710:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 24 00010000:00010000:1.0:1788581987.056597:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581987.233581:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788581987.233669:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001951488 00000100:00100000:0.0:1788581987.233680:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001951488 00000100:00100000:0.0:1788581987.233739:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 171 00000100:00100000:0.0:1788581987.233750:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+9:5589:x1875464001951488:12345-192.168.201.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581987.233767:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581987.233786:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0da7088200/0x2bc3aa892c3a6c10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c901b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581987.233821:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0da7088200/0x2bc3aa892c3a6c10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c901b expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581987.233843:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0da7088200/0x2bc3aa892c3a6c10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c901b expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581987.233853:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7088200, rc 0) 00000100:00100000:0.0:1788581987.233915:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:5589:x1875464001951488:12345-192.168.201.12@tcp:101:ll_cfg_requeue.0 Request processed in 166us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581987.233923:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 171 00000100:00100000:1.0:1788581987.253496:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788581987.253564:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001951616 00000100:00100000:2.0:1788581987.253575:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001951616 00000100:00100000:2.0:1788581987.253630:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 172 00000100:00100000:2.0:1788581987.253640:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:5589:x1875464001951616:12345-192.168.201.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581987.254069:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:5589:x1875464001951616:12345-192.168.201.12@tcp:501:ll_cfg_requeue.0 Request processed in 428us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581987.254077:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 172 00000100:00100000:1.0:1788581987.260991:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788581987.261120:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001951744 00000100:00100000:3.0:1788581987.261130:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001951744 00000100:00100000:3.0:1788581987.261362:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 173 00000100:00100000:3.0:1788581987.261373:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:5589:x1875464001951744:12345-192.168.201.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788581987.261581:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:5589:x1875464001951744:12345-192.168.201.12@tcp:503:ll_cfg_requeue.0 Request processed in 209us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581987.261589:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 173 00000100:00100000:1.0:1788581987.271912:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788581987.272590:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001951872 00000100:00100000:0.0:1788581987.272602:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001951872 00000100:00100000:0.0:1788581987.272652:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 174 00000100:00100000:0.0:1788581987.272663:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:6119:x1875464001951872:12345-192.168.201.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788581987.272932:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:6119:x1875464001951872:12345-192.168.201.12@tcp:502:llog_process_th.0 Request processed in 269us (1029us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581987.272941:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 174 00000100:00100000:1.0:1788581987.285239:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788581987.285471:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001952000 00000100:00100000:3.0:1788581987.285481:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001952000 00000100:00100000:3.0:1788581987.285567:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 175 00000100:00100000:3.0:1788581987.285578:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:6119:x1875464001952000:12345-192.168.201.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788581987.285847:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:6119:x1875464001952000:12345-192.168.201.12@tcp:502:llog_process_th.0 Request processed in 271us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581987.285856:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 175 10000000:01000000:1.0:1788581988.020809:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788581988.020826:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0dbf4ee800 from 4 10000000:01000000:1.0:1788581988.020831:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788581988.020876:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8167da00/0x2bc3aa892c3a6c17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581988.020889:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d8167da00/0x2bc3aa892c3a6c17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581988.020910:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d8167da00/0x2bc3aa892c3a6c17 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581988.021707:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020852992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788581988.021779:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581988.021841:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbfd6fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581988.022063:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020852992 00000100:00100000:2.0:1788581988.022072:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020852992 00000100:00100000:2.0:1788581988.022127:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788581988.022137:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:5840:x1875464020852992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581988.022153:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788581988.022170:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8138ee00/0x2bc3aa892c3a6c1e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6c17 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581988.022192:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8138ee00/0x2bc3aa892c3a6c1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6c17 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581988.022321:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8138ee00/0x2bc3aa892c3a6c1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6c17 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581988.022345:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8138ee00, rc 0) 00000100:00100000:2.0:1788581988.022389:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020852992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 252us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581988.022396:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788581988.022439:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020852992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788581988.022455:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d8167da00/0x2bc3aa892c3a6c17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6c1e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581988.022463:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d8167da00/0x2bc3aa892c3a6c17 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6c1e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788581988.022530:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020853120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581988.022556:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581988.022571:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581988.022584:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020853120 00000100:00100000:2.0:1788581988.022587:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020853120 00000100:00100000:2.0:1788581988.022608:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788581988.022614:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020853120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581988.022850:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020853120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 235us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581988.022858:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1788581988.022885:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020853120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788581988.022912:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020853248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581988.022960:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581988.022980:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788581988.022991:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020853248 00000100:00100000:2.0:1788581988.022994:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020853248 00000100:00100000:2.0:1788581988.023011:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788581988.023016:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020853248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581988.023146:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020853248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 129us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581988.023153:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788581988.023185:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd94700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020853248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788581988.031891:0:8612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd94700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8612:1875464020853376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788581988.031991:0:8612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581988.032045:0:8612:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c3c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788581988.032168:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020853376 00000100:00100000:0.0:1788581988.032177:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020853376 00000100:00100000:0.0:1788581988.032251:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788581988.032261:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:8612:x1875464020853376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581988.032482:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:8612:x1875464020853376:12345-0@lo:502:llog_process_th.0 Request processed in 222us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581988.032490:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1788581988.032592:0:8612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd94700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8612:1875464020853376:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788581988.032623:0:8612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788581988.032633:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581988.032636:0:8612:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788581988.032643:0:8612:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d0dbf4ee800 00000020:00000080:1.0:1788581988.032645:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788581988.032745:0:8612:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8612:1875464020853504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581988.032784:0:8612:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581988.032806:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020853504 00000100:00100000:1.0:1788581988.032810:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020853504 00000100:00100000:1.0:1788581988.032847:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788581988.032853:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:8612:x1875464020853504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788581988.032971:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:8612:x1875464020853504:12345-0@lo:502:llog_process_th.0 Request processed in 117us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581988.032978:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788581988.033014:0:8612:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbfd6f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788581988.033026:0:8612:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8612:1875464020853504:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788581988.033043:0:8612:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788581988.033048:0:8612:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788581988.033049:0:8612:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1788581988.033053:0:8612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788581988.033112:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788581988.033127:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788581988.033137:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8167da00/0x2bc3aa892c3a6c17 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6c1e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581988.033148:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d8167da00/0x2bc3aa892c3a6c17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6c1e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788581988.033157:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788581988.033160:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0dac39a800 from 4 10000000:01000000:1.0:1788581988.033163:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788581988.033185:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581988.033226:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581988.033237:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581988.033250:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020853632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788581988.033276:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581988.033290:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbfd6f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788581988.033301:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020853632 00000100:00100000:1.0:1788581988.033304:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020853632 00000100:00100000:1.0:1788581988.033322:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788581988.033327:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020853632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581988.033335:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788581988.033347:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8167d800/0x2bc3aa892c3a6c2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6c25 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581988.033366:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8167d800/0x2bc3aa892c3a6c2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6c25 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581988.033374:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8167d800/0x2bc3aa892c3a6c2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6c25 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581988.033383:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8167d800, rc 0) 00000100:00100000:1.0:1788581988.033410:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020853632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 82us (133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581988.033417:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788581988.033451:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020853632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788581988.033462:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6c2c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788581988.033471:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6c2c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788581988.033509:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020853760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581988.033531:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581988.033543:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbfd6f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788581988.033552:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020853760 00000100:00100000:1.0:1788581988.033555:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020853760 00000100:00100000:1.0:1788581988.033569:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788581988.033575:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020853760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581988.033761:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020853760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 186us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581988.033769:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788581988.033796:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020853760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788581988.033836:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020853888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581988.033869:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581988.033883:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbfd6f540 going to sleep for 11 seconds 00000100:00100000:1.0:1788581988.033893:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020853888 00000100:00100000:1.0:1788581988.033897:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020853888 00000100:00100000:1.0:1788581988.033914:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788581988.033920:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020853888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788581988.034029:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020853888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581988.034041:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788581988.034074:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020853888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581988.047640:0:8613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8613:1875464020854016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581988.047719:0:8613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581988.047768:0:8613:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d9dd5e600 going to sleep for 11 seconds 00000100:00100000:3.0:1788581988.048140:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020854016 00000100:00100000:3.0:1788581988.048149:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020854016 00000100:00100000:3.0:1788581988.048197:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788581988.048236:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:8613:x1875464020854016:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788581988.048439:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:8613:x1875464020854016:12345-0@lo:502:llog_process_th.0 Request processed in 205us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581988.048447:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788581988.048795:0:8613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8613:1875464020854016:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788581988.053436:0:8613:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581988.053450:0:8613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581988.053452:0:8613:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788581988.053460:0:8613:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d0dac39a800 00000020:00000080:0.0:1788581988.053463:0:8613:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788581988.053565:0:8613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8613:1875464020854144:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581988.053635:0:8613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581988.053689:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020854144 00000100:00100000:0.0:1788581988.053696:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020854144 00000100:00100000:0.0:1788581988.053737:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788581988.053745:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:8613:x1875464020854144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581988.053962:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:8613:x1875464020854144:12345-0@lo:502:llog_process_th.0 Request processed in 217us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581988.053970:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788581988.054303:0:8613:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d9dd5e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788581988.054325:0:8613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8613:1875464020854144:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788581988.054348:0:8613:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581988.054353:0:8613:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581988.054355:0:8613:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788581988.054358:0:8613:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788581988.054485:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788581988.054503:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788581988.054511:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6c2c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581988.054521:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6c2c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788581988.054532:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788581988.054535:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0d945e5800 from 4 10000000:01000000:0.0:1788581988.054538:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788581988.054560:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7089c00/0x2bc3aa892c3a6c33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581988.054569:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0da7089c00/0x2bc3aa892c3a6c33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581988.054578:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0da7089c00/0x2bc3aa892c3a6c33 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581988.054591:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd91c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020854272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788581988.054626:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581988.054643:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d9dd5e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788581988.054656:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020854272 00000100:00100000:0.0:1788581988.054746:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020854272 00000100:00100000:0.0:1788581988.054773:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788581988.054780:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020854272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581988.054790:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788581988.054801:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a6c3a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6c33 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581988.054831:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a6c3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6c33 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581988.054842:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a6c3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6c33 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581988.054852:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7089000, rc 0) 00000100:00100000:0.0:1788581988.054882:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020854272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 102us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581988.054889:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788581988.054920:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd91c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020854272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788581988.054932:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0da7089c00/0x2bc3aa892c3a6c33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6c3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581988.054941:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0da7089c00/0x2bc3aa892c3a6c33 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6c3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788581988.054983:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd91c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020854400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581988.055015:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581988.055028:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d9dd5e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788581988.055039:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020854400 00000100:00100000:0.0:1788581988.055042:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020854400 00000100:00100000:0.0:1788581988.055062:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788581988.055068:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020854400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581988.055290:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020854400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 222us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581988.055298:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788581988.055324:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd91c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020854400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788581988.055346:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd91c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020854528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581988.055378:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581988.055396:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d9dd5e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788581988.055405:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020854528 00000100:00100000:0.0:1788581988.055409:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020854528 00000100:00100000:0.0:1788581988.055428:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788581988.055433:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020854528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581988.055542:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020854528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 108us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581988.055549:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788581988.055579:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd91c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020854528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788581988.070637:0:8617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8617:1875464020854656:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581988.070744:0:8617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581988.070785:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020854656 00000100:00100000:0.0:1788581988.070798:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020854656 00000100:00100000:0.0:1788581988.070856:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788581988.070867:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:8617:x1875464020854656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581988.071069:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:8617:x1875464020854656:12345-0@lo:502:llog_process_th.0 Request processed in 204us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581988.071077:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788581988.071127:0:8617:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d9dd5e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788581988.071149:0:8617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8617:1875464020854656:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788581988.071176:0:8617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788581988.071184:0:8617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581988.071186:0:8617:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788581988.071195:0:8617:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d0d945e5800 00000020:00000080:0.0:1788581988.071198:0:8617:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788581988.071301:0:8617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8617:1875464020854784:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581988.071334:0:8617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581988.071354:0:8617:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8a934f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788581988.071757:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020854784 00000100:00100000:0.0:1788581988.071762:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020854784 00000100:00100000:0.0:1788581988.071791:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788581988.071799:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:8617:x1875464020854784:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788581988.071971:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:8617:x1875464020854784:12345-0@lo:502:llog_process_th.0 Request processed in 172us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581988.071979:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1788581988.072021:0:8617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd91c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:8617:1875464020854784:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788581988.072041:0:8617:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788581988.072046:0:8617:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788581988.072052:0:8617:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788581988.072057:0:8617:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788581988.072183:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788581988.072224:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788581988.072233:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7089c00/0x2bc3aa892c3a6c33 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6c3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788581988.072244:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0da7089c00/0x2bc3aa892c3a6c33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6c3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788581988.078940:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581988.845351:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020854912:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581988.845409:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581988.845521:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020854912 00000100:00100000:2.0:1788581988.845529:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020854912 00000100:00100000:2.0:1788581988.845591:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788581988.845599:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020854912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581988.845633:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581988.845678:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020854912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581988.845683:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1788581988.845723:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbbd91c00 x1875464020854912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581988.845738:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020854912:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788581988.845797:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788581988.845989:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020855168:0@lo:400:kworker.0 00000100:00100000:2.0:1788581988.846041:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581988.846062:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788581988.846068:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020855296:0@lo:400:kworker.0 00000100:00100000:2.0:1788581988.846088:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581988.846113:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020855168 00000100:00100000:2.0:1788581988.846117:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020855168 00000100:00100000:2.0:1788581988.846154:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788581988.846161:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020855168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581988.846194:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020855168:12345-0@lo:400:kworker.0 Request processed in 34us (163us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581988.846217:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788581988.846233:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020855296 00000100:00100000:2.0:1788581988.846235:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020855296 00000100:00100000:2.0:1788581988.846257:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788581988.846262:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020855296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581988.846286:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020855296:12345-0@lo:400:kworker.0 Request processed in 24us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581988.846292:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1788581988.846308:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788581988.846310:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788581988.846323:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0d9dd96a00 x1875464020855296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581988.846333:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020855296:0@lo:400:kworker.0 00000100:00100000:2.0:1788581988.846341:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020855168:0@lo:400:kworker.0 00000100:00100000:3.0:1788581988.846403:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020855424:0@lo:400:kworker.0 00000100:00100000:3.0:1788581988.846428:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581988.846445:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788581988.846449:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020855040:0@lo:400:kworker.0 00000100:00100000:3.0:1788581988.846466:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788581988.846483:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020855424 00000100:00100000:3.0:1788581988.846486:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020855424 00000100:00100000:3.0:1788581988.846508:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020855040 00000100:00100000:3.0:1788581988.846511:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020855040 00000100:00100000:3.0:1788581988.846522:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788581988.846527:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020855424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581988.846560:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020855424:12345-0@lo:400:kworker.0 Request processed in 33us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581988.846566:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788581988.846578:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788581988.846583:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020855040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581988.846617:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020855040:12345-0@lo:400:kworker.0 Request processed in 34us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581988.846623:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788581988.846636:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788581988.846651:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020855040:0@lo:400:kworker.0 00000100:00100000:3.0:1788581988.846658:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020855424:0@lo:400:kworker.0 00010000:00010000:1.0:1788581989.101751:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581990.126416:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788581990.242762:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788581990.242822:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788581990.242859:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788581990.242895:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788581990.243373:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001952256 00000100:00100000:2.0:1788581990.243384:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001952256 00000100:00100000:2.0:1788581990.243445:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 29 00000100:00100000:2.0:1788581990.243455:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:2351:x1875464001952256:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788581990.243876:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:2351:x1875464001952256:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 409us (1110us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581990.243885:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 29 00000100:00100000:2.0:1788581990.244055:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001952512 00000100:00100000:2.0:1788581990.244059:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001952512 00000100:00100000:2.0:1788581990.244089:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001952384 00000100:00100000:2.0:1788581990.244092:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001952384 00000100:00100000:2.0:1788581990.244114:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 14 00000100:00100000:2.0:1788581990.244121:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+5:2351:x1875464001952512:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788581990.244155:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+5:2351:x1875464001952512:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 34us (1332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581990.244161:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 14 00000100:00100000:2.0:1788581990.244309:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 15 00000100:00100000:2.0:1788581990.244317:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+5:2351:x1875464001952384:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788581990.244344:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+5:2351:x1875464001952384:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 28us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581990.244351:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 15 00000100:00080000:2.0:1788581990.244369:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788581990.244374:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581990.244376:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581990.244898:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001952128 00000100:00100000:0.0:1788581990.244920:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001952128 00000100:00100000:0.0:1788581990.244956:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 191 00000100:00100000:0.0:1788581990.244964:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2351:x1875464001952128:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788581990.244997:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2351:x1875464001952128:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 34us (2137us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581990.245004:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 191 00000100:00100000:1.0:1788581990.381854:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788581990.381888:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020855552:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788581990.381969:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581990.382133:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020855552 00000100:00100000:2.0:1788581990.382143:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020855552 00000100:00100000:2.0:1788581990.382238:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788581990.382249:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020855552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581990.382285:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581990.382333:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020855552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581990.382340:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788581990.382380:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0d9dd95500 x1875464020855552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582006 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581990.382398:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020855552:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788581990.382847:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788581991.150038:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788581991.733647:0:8811:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg112-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788581992.175937:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788581993.200358:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788581993.965915:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020856064:0@lo:400:kworker.0 00000100:00100000:0.0:1788581993.965981:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581993.966036:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788581993.966042:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875464020855936:0@lo:400:kworker.0 00000100:00100000:0.0:1788581993.966086:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788581993.966119:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020855936 00000100:00100000:0.0:1788581993.966126:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020855936 00000100:00100000:0.0:1788581993.966191:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788581993.966199:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875464020855936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581993.966259:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875464020855936:12345-0@lo:400:kworker.0 Request processed in 61us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581993.966266:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788581993.966286:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788581993.966310:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875464020855936:0@lo:400:kworker.0 00000100:00100000:2.0:1788581993.966739:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020855680:0@lo:400:kworker.0 00000100:00100000:2.0:1788581993.966773:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581993.966807:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020856192:0@lo:400:kworker.0 00000100:00100000:2.0:1788581993.966827:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581993.966844:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788581993.966850:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020855808:0@lo:400:kworker.0 00000100:00100000:2.0:1788581993.966867:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581993.966880:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020856320:0@lo:400:kworker.0 00000100:00100000:2.0:1788581993.966900:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581993.966930:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020856064 00000100:00100000:2.0:1788581993.966934:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020856064 00000100:00100000:2.0:1788581993.966960:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020856320 00000100:00100000:2.0:1788581993.966963:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020856320 00000100:00100000:2.0:1788581993.966980:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788581993.966985:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020856064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581993.967027:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020856064:12345-0@lo:400:kworker.0 Request processed in 41us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581993.967033:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788581993.967044:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788581993.967050:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020856320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581993.967076:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020856320:12345-0@lo:400:kworker.0 Request processed in 27us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581993.967081:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788581993.967094:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020856192 00000100:00100000:2.0:1788581993.967107:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020856192 00000100:00100000:2.0:1788581993.967123:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020855808 00000100:00100000:2.0:1788581993.967125:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020855808 00000100:00100000:2.0:1788581993.967135:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788581993.967139:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020856192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581993.967165:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020856192:12345-0@lo:400:kworker.0 Request processed in 25us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581993.967171:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788581993.967181:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788581993.967187:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020855808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581993.967235:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020855808:12345-0@lo:400:kworker.0 Request processed in 48us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581993.967241:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1788581993.967266:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788581993.967269:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788581993.967271:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788581993.967290:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020855808:0@lo:400:kworker.0 00010000:00080000:2.0:1788581993.967312:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbbd91880 x1875464020856320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581993.967322:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020856320:0@lo:400:kworker.0 00000100:00100000:2.0:1788581993.967331:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020856192:0@lo:400:kworker.0 00000100:00100000:1.0:1788581993.967335:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbc59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020856448:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788581993.967356:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbbd92300 x1875464020856064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581993.967364:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020856064:0@lo:400:kworker.0 00000100:00100000:1.0:1788581993.967364:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788581993.967407:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020856448 00000100:00100000:1.0:1788581993.967411:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020856448 00000100:00100000:1.0:1788581993.967457:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788581993.967464:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020856448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788581993.967491:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788581993.967524:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc5ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020856448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581993.967530:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1788581993.967569:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbbc59180 x1875464020856448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581993.967582:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbc59180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020856448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788581993.968119:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020855680 00000100:00100000:0.0:1788581993.968124:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020855680 00000100:00100000:0.0:1788581993.968152:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788581993.968159:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3306:x1875464020855680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788581993.968194:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3306:x1875464020855680:12345-0@lo:400:kworker.0 Request processed in 36us (1420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581993.968222:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020855680:0@lo:400:kworker.0 00000100:00100000:0.0:1788581993.968224:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00010000:00010000:0.0:1788581994.221318:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581995.249316:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581995.356040:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788581995.356098:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788581995.356156:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788581995.356191:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788581995.356239:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001953024 00000100:00100000:1.0:1788581995.356251:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001953024 00000100:00100000:0.0:1788581995.356286:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001952896 00000100:00100000:0.0:1788581995.356290:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001952896 00000100:00100000:1.0:1788581995.356315:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 18 00000100:00100000:1.0:1788581995.356327:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+5:2351:x1875464001953024:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788581995.356394:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 19 00000100:00100000:0.0:1788581995.356401:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+5:2351:x1875464001952896:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788581995.356409:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc58000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+5:2351:x1875464001953024:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 85us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788581995.356416:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 18 00000100:00100000:0.0:1788581995.356426:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc59500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+5:2351:x1875464001952896:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 26us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581995.356433:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 19 00000100:00080000:1.0:1788581995.356450:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788581995.356452:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001952640 00000100:00080000:1.0:1788581995.356454:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788581995.356455:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001952640 00000100:00100000:0.0:1788581995.356491:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 193 00000100:00100000:0.0:1788581995.356497:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2351:x1875464001952640:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788581995.356529:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2351:x1875464001952640:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 32us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788581995.356535:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 193 00000100:00100000:2.0:1788581995.356671:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001952768 00000100:00100000:2.0:1788581995.356676:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001952768 00000100:00100000:2.0:1788581995.357734:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 33 00000100:00100000:2.0:1788581995.357746:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:2351:x1875464001952768:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788581995.357797:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc59180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:2351:x1875464001952768:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 55us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581995.357804:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 33 00000100:00080000:1.0:1788581995.362401:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581995.501397:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788581995.501426:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020856576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788581995.501525:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581995.501604:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020856576 00000100:00100000:2.0:1788581995.501612:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020856576 00000100:00100000:2.0:1788581995.501669:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788581995.501680:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020856576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788581995.501732:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581995.501792:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020856576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581995.501800:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1788581995.502018:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788581995.502052:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0d9dd97800 x1875464020856576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582011 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581995.502070:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020856576:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788581996.270427:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788581996.489965:0:9056:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg112-server.virtnet: executing yml_node 00010000:00010000:0.0:1788581997.293399:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788581998.317721:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788581999.085395:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788581999.085418:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbc59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020856704:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788581999.085484:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581999.085571:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020856704 00000100:00100000:2.0:1788581999.085580:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020856704 00000100:00100000:2.0:1788581999.085670:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788581999.085680:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020856704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788581999.085714:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788581999.085757:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc5b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020856704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581999.085764:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788581999.085773:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020856960:0@lo:400:kworker.0 00000100:00100000:3.0:1788581999.085774:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875464020857088:0@lo:400:kworker.0 00000100:00100000:2.0:1788581999.085785:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020857216:0@lo:400:kworker.0 00000100:00100000:3.0:1788581999.085820:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581999.085837:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581999.085856:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788581999.085862:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020856832:0@lo:400:kworker.0 00000100:00100000:3.0:1788581999.085879:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020857088 00000100:00100000:3.0:1788581999.085883:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020857088 00000100:00100000:2.0:1788581999.085889:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788581999.085910:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020857344:0@lo:400:kworker.0 00000100:00100000:3.0:1788581999.085912:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788581999.085918:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875464020857088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581999.085936:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020857216 00000100:00100000:2.0:1788581999.085940:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020857216 00000100:00100000:3.0:1788581999.085952:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875464020857088:12345-0@lo:400:kworker.0 Request processed in 34us (132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788581999.085958:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788581999.085964:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788581999.085970:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020857216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788581999.085990:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875464020857088:0@lo:400:kworker.0 00000100:00100000:2.0:1788581999.086003:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020857216:12345-0@lo:400:kworker.0 Request processed in 33us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581999.086022:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788581999.086075:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788581999.086493:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788581999.086498:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788581999.086500:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788581999.086522:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbbc59c00 x1875464020856704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788581999.086536:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbc59c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020856704:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788581999.086597:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020856832 00000100:00100000:2.0:1788581999.086602:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020856832 00000100:00100000:2.0:1788581999.086893:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788581999.086902:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3306:x1875464020856832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581999.086941:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3306:x1875464020856832:12345-0@lo:400:kworker.0 Request processed in 42us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581999.086947:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788581999.086973:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020856960 00000100:00100000:2.0:1788581999.086977:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020856960 00000100:00100000:2.0:1788581999.087001:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788581999.087008:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020856960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581999.087043:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020856960:12345-0@lo:400:kworker.0 Request processed in 35us (969us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581999.087049:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788581999.087071:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788581999.087097:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0d90d10380 x1875464020857216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788581999.087107:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020857216:0@lo:400:kworker.0 00000100:00100000:2.0:1788581999.087121:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020856832:0@lo:400:kworker.0 00000100:00100000:2.0:1788581999.087136:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020857344 00000100:00100000:2.0:1788581999.087139:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020857344 00000100:00100000:2.0:1788581999.087168:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788581999.087174:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020857344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788581999.087225:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020857344:12345-0@lo:400:kworker.0 Request processed in 52us (153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788581999.087312:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1788581999.087329:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788581999.087348:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020857344:0@lo:400:kworker.0 00000100:00100000:0.0:1788581999.090802:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020856960:0@lo:400:kworker.0 00010000:00010000:1.0:1788581999.354885:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788581999.990819:0:9247:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.104 00010000:00010000:0.0:1788582000.368336:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582000.478122:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582000.478176:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582000.478231:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001953152 00000100:00100000:0.0:1788582000.478241:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001953152 00000100:00100000:0.0:1788582000.478291:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 195 00000100:00100000:0.0:1788582000.478302:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2350:x1875464001953152:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582000.478381:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2350:x1875464001953152:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 81us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582000.478389:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 195 00000100:00100000:1.0:1788582000.480118:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001953280 00000100:00100000:1.0:1788582000.480130:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001953280 00000100:00100000:1.0:1788582000.480229:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 37 00000100:00100000:1.0:1788582000.480239:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+6:2350:x1875464001953280:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582000.480333:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+6:2350:x1875464001953280:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 95us (2221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582000.480340:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 37 00000100:00080000:0.0:1788582000.481630:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788582000.488996:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582000.489028:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582000.489052:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001953408 00000100:00100000:1.0:1788582000.489060:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001953408 00000100:00100000:1.0:1788582000.489113:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001953536 00000100:00100000:1.0:1788582000.489116:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001953536 00000100:00100000:1.0:1788582000.489139:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 10 00000100:00100000:1.0:1788582000.489150:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+5:2348:x1875464001953408:12345-192.168.201.12@tcp:9:kworker.0 00000020:00000080:1.0:1788582000.489187:0:8034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6b76 00000100:00080000:1.0:1788582000.489195:0:8034:0:(import.c:65:import_set_state_nolock()) ffff8d0dabc27800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788582000.489256:0:8034:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788582000.489574:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+2:2348:x1875464001953408:12345-192.168.201.12@tcp:9:kworker.0 Request processed in 425us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582000.489582:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 10 00000100:00100000:1.0:1788582000.489618:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 11 00000100:00100000:1.0:1788582000.489626:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+5:2348:x1875464001953536:12345-192.168.201.12@tcp:9:kworker.0 00000020:00000080:1.0:1788582000.489638:0:8034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6b7d 00000100:00080000:1.0:1788582000.489644:0:8034:0:(import.c:65:import_set_state_nolock()) ffff8d0dbfa14800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788582000.489662:0:8034:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788582000.489881:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc5a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+2:2348:x1875464001953536:12345-192.168.201.12@tcp:9:kworker.0 Request processed in 255us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582000.489888:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 11 00010000:00010000:1.0:1788582000.489909:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582000.489920:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788582000.489926:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788582000.489930:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788582000.623140:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020857472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788582000.623243:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582000.623369:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020857472 00000100:00100000:3.0:1788582000.623377:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020857472 00000100:00100000:3.0:1788582000.623424:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788582000.623433:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020857472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788582000.623469:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788582000.631086:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc5b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020857472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7634us (7823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582000.631105:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788582000.635062:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbbd92300 x1875464020857472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582016 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582000.635093:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020857472:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788582001.389690:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788582001.701625:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b99087a3-3c83-4416-b2b9-d522b9885111 00000020:00000080:3.0:1788582001.701634:0:6716:0:(genops.c:885:class_export_put()) final put ffff8d0dabc20800/b99087a3-3c83-4416-b2b9-d522b9885111 00000020:00000080:3.0:1788582001.701660:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dabc20800/b99087a3-3c83-4416-b2b9-d522b9885111 for lustre-OST0000 00000020:00000080:3.0:1788582001.701700:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d0dabc27800 for lustre-OST0000 00000001:02000400:3.0:1788582002.299293:0:9347:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.104 00010000:00010000:1.0:1788582002.413370:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582003.454879:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582004.205921:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbc58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020857600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788582004.206001:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582004.206254:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020857600 00000100:00100000:1.0:1788582004.206263:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020857600 00000100:00100000:1.0:1788582004.206328:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788582004.206337:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020857600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788582004.206369:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788582004.206423:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020857600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582004.206431:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1788582004.206506:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbbc58380 x1875464020857600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582004.206527:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbc58380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020857600:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788582004.206685:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788582004.210007:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020857984:0@lo:400:kworker.0 00000100:00100000:2.0:1788582004.210071:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582004.210106:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788582004.210112:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020858112:0@lo:400:kworker.0 00000100:00100000:2.0:1788582004.210134:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582004.210159:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020857984 00000100:00100000:2.0:1788582004.210165:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020857984 00000100:00100000:2.0:1788582004.210234:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788582004.210243:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020857984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582004.210289:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020857984:12345-0@lo:400:kworker.0 Request processed in 47us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582004.210296:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788582004.210314:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788582004.210337:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020857984:0@lo:400:kworker.0 00000100:00100000:3.0:1788582004.210450:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020857728:0@lo:400:kworker.0 00000100:00100000:3.0:1788582004.210482:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582004.210512:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020858240:0@lo:400:kworker.0 00000100:00100000:3.0:1788582004.210548:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582004.210563:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788582004.210568:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020857856:0@lo:400:kworker.0 00000100:00100000:3.0:1788582004.210586:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582004.210708:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020858112 00000100:00100000:1.0:1788582004.210713:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020858112 00000100:00100000:1.0:1788582004.210754:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788582004.210761:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020858112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582004.210797:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020858112:12345-0@lo:400:kworker.0 Request processed in 37us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582004.210803:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788582004.210819:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020858240 00000100:00100000:1.0:1788582004.210821:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020858240 00000100:00100000:1.0:1788582004.210848:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020857856 00000100:00100000:1.0:1788582004.210851:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020857856 00000100:00100000:1.0:1788582004.210861:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788582004.210865:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020858240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582004.210895:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d12300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020858240:12345-0@lo:400:kworker.0 Request processed in 29us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582004.210901:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788582004.210910:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788582004.210914:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020857856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582004.210947:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020857856:12345-0@lo:400:kworker.0 Request processed in 32us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582004.210952:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788582004.210976:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020857856:0@lo:400:kworker.0 00000100:00100000:1.0:1788582004.210984:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020858240:0@lo:400:kworker.0 00010000:00080000:1.0:1788582004.211005:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0d9dd97480 x1875464020858112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582004.211016:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020858112:0@lo:400:kworker.0 00000100:00080000:3.0:1788582004.211108:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788582004.211112:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788582004.211198:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020857728 00000100:00100000:2.0:1788582004.211225:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020857728 00000100:00100000:2.0:1788582004.211247:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788582004.211252:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3306:x1875464020857728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582004.211297:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3306:x1875464020857728:12345-0@lo:400:kworker.0 Request processed in 44us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582004.211303:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788582004.211414:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020857728:0@lo:400:kworker.0 00010000:00010000:3.0:1788582004.461956:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788582004.770060:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b99087a3-3c83-4416-b2b9-d522b9885111 00000020:00000080:1.0:1788582004.770069:0:7648:0:(genops.c:885:class_export_put()) final put ffff8d0dbfa11800/b99087a3-3c83-4416-b2b9-d522b9885111 00000020:00000080:1.0:1788582004.770100:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dbfa11800/b99087a3-3c83-4416-b2b9-d522b9885111 for lustre-OST0001 00000020:00000080:1.0:1788582004.770142:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d0dbfa14800 for lustre-OST0001 00000001:02000400:0.0:1788582005.032043:0:9444:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.104 00010000:00010000:1.0:1788582005.485505:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582005.603873:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582005.603935:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582005.603939:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001953664 00000100:00100000:0.0:1788582005.603950:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001953664 00000100:00100000:0.0:1788582005.604026:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 197 00000100:00100000:0.0:1788582005.604037:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2352:x1875464001953664:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582005.604111:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2352:x1875464001953664:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 76us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582005.604119:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 197 00000100:00100000:3.0:1788582005.604289:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001953792 00000100:00100000:3.0:1788582005.604294:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001953792 00000100:00080000:2.0:1788582005.604345:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788582005.604352:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 41 00000100:00100000:3.0:1788582005.604359:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+6:2352:x1875464001953792:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582005.604412:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc5a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+6:2352:x1875464001953792:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 54us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582005.604419:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 41 00000100:00100000:3.0:1788582005.743658:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788582005.743683:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020858368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788582005.743774:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582005.744129:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020858368 00000100:00100000:0.0:1788582005.744138:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020858368 00000100:00100000:0.0:1788582005.744196:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788582005.744243:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020858368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788582005.744282:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582005.744341:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020858368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582005.744349:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1788582005.744558:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbbd91880 x1875464020858368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582021 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582005.744578:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020858368:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788582006.510150:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788582006.751749:0:9492:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Sep 5 00:20:04 EDT 2026 00010000:00010000:0.0:1788582007.533413:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582008.558520:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582009.326942:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875464020858624:0@lo:400:kworker.0 00000100:00100000:2.0:1788582009.327011:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582009.327061:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020859136:0@lo:400:kworker.0 00000100:00100000:2.0:1788582009.327088:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582009.327118:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788582009.327125:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020858496:0@lo:400:kworker.0 00000100:00100000:2.0:1788582009.327154:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582009.327183:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875464020859008:0@lo:400:kworker.0 00000100:00100000:2.0:1788582009.327225:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582009.327261:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020858624 00000100:00100000:2.0:1788582009.327268:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020858624 00000100:00100000:2.0:1788582009.327308:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020859008 00000100:00100000:2.0:1788582009.327311:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020859008 00000100:00100000:2.0:1788582009.327336:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788582009.327345:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875464020858624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582009.327396:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaef9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875464020858624:12345-0@lo:400:kworker.0 Request processed in 51us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582009.327403:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788582009.327419:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788582009.327425:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaefa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875464020859008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582009.327468:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaefa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875464020859008:12345-0@lo:400:kworker.0 Request processed in 43us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582009.327482:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1788582009.327498:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788582009.327527:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875464020859008:0@lo:400:kworker.0 00000100:00100000:2.0:1788582009.327538:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875464020858624:0@lo:400:kworker.0 00000100:00100000:0.0:1788582009.332845:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020858496 00000100:00100000:0.0:1788582009.332860:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020858496 00000100:00100000:0.0:1788582009.332971:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788582009.332981:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3309:x1875464020858496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582009.333075:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3309:x1875464020858496:12345-0@lo:400:kworker.0 Request processed in 96us (5920us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582009.333082:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788582009.333142:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd97100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020858496:0@lo:400:kworker.0 00000100:00100000:2.0:1788582009.337666:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020858752:0@lo:400:kworker.0 00000100:00100000:2.0:1788582009.337744:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582009.337971:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020858880:0@lo:400:kworker.0 00000100:00100000:1.0:1788582009.338018:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582009.338228:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788582009.338237:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020859264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788582009.338267:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582009.338308:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020859136 00000100:00100000:3.0:1788582009.338314:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020859264 00000100:00100000:1.0:1788582009.338316:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020859136 00000100:00100000:3.0:1788582009.338322:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020859264 00000100:00100000:1.0:1788582009.338372:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020858880 00000100:00100000:1.0:1788582009.338377:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020858880 00000100:00100000:3.0:1788582009.338381:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788582009.338395:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875464020859264:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788582009.338405:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788582009.338414:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaefb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875464020859136:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1788582009.338432:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788582009.338489:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaefb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875464020859136:12345-0@lo:400:kworker.0 Request processed in 76us (11399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582009.338499:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc59880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1875464020859264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582009.338499:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788582009.338509:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788582009.338534:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788582009.338543:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020858880:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788582009.338551:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbaef8380 x1875464020859264/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788582009.338570:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020859264:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788582009.338985:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020858752 00000100:00100000:2.0:1788582009.338991:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020858752 00000100:00100000:1.0:1788582009.339126:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020858880:12345-0@lo:400:kworker.0 Request processed in 585us (1109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582009.339134:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788582009.339265:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788582009.339276:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788582009.339279:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788582009.339312:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbaef9500 x1875464020859136/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582009.339319:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788582009.339332:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020859136:0@lo:400:kworker.0 00000100:00100000:2.0:1788582009.339336:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaefb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020858752:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788582009.339367:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0d9dd94380 x1875464020858880/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582009.339376:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd94380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020858880:0@lo:400:kworker.0 00000100:00100000:2.0:1788582009.339383:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaefb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020858752:12345-0@lo:400:kworker.0 Request processed in 52us (1638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582009.339391:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788582009.339504:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020858752:0@lo:400:kworker.0 00010000:00010000:1.0:1788582009.581399:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582010.605476:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582010.716182:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582010.716264:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582010.716354:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001954048 00000100:00100000:0.0:1788582010.716365:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001954048 00000100:00100000:0.0:1788582010.716449:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 45 00000100:00100000:0.0:1788582010.716460:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+6:2352:x1875464001954048:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582010.716554:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc5bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+6:2352:x1875464001954048:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 96us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582010.716562:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 45 00000100:00080000:1.0:1788582010.716724:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788582010.716821:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001953920 00000100:00100000:2.0:1788582010.716826:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001953920 00000100:00100000:2.0:1788582010.716861:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 199 00000100:00100000:2.0:1788582010.716869:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2352:x1875464001953920:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788582010.716911:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2352:x1875464001953920:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 42us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582010.716918:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 199 00000100:00100000:1.0:1788582010.861499:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020859392:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788582010.861572:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582010.861739:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020859392 00000100:00100000:3.0:1788582010.861748:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020859392 00000100:00100000:3.0:1788582010.862075:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788582010.862088:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020859392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788582010.862125:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788582010.862186:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc58700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020859392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (612us total) trans 0 rc 0/0 00010000:00080000:1.0:1788582010.862249:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbbd93100 x1875464020859392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582026 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582010.862267:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020859392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788582010.862556:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788582011.631068:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582012.653346:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582013.685780:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582014.447052:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaefa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020859520:0@lo:400:kworker.0 00000100:00100000:2.0:1788582014.447127:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582014.448073:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020860032:0@lo:400:kworker.0 00000100:00100000:2.0:1788582014.448109:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582014.448147:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788582014.448153:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020859648:0@lo:400:kworker.0 00000100:00100000:2.0:1788582014.448172:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582014.448190:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaefb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020860160:0@lo:400:kworker.0 00000100:00100000:2.0:1788582014.448236:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582014.448271:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020859776:0@lo:400:kworker.0 00000100:00100000:2.0:1788582014.448293:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582014.448307:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020860288:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788582014.448325:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582014.448344:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788582014.448350:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020859904:0@lo:400:kworker.0 00000100:00100000:2.0:1788582014.448378:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582014.448408:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020859520 00000100:00100000:2.0:1788582014.448415:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020859520 00000100:00100000:2.0:1788582014.448461:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788582014.448470:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020859520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582014.448519:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020859520:12345-0@lo:400:kworker.0 Request processed in 50us (1392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582014.448527:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1788582014.448559:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020860032 00000100:00100000:2.0:1788582014.448562:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020860032 00000100:00100000:2.0:1788582014.448588:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020859648 00000100:00100000:2.0:1788582014.448590:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020859648 00000100:00100000:2.0:1788582014.448599:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020859776 00000100:00100000:2.0:1788582014.448601:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020859776 00000100:00100000:2.0:1788582014.448625:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788582014.448630:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020860032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582014.448660:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaef8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020860032:12345-0@lo:400:kworker.0 Request processed in 30us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582014.448666:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788582014.448677:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788582014.448682:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaefaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020859648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582014.448703:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaefaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020859648:12345-0@lo:400:kworker.0 Request processed in 21us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582014.448720:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788582014.448731:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788582014.448737:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020859776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582014.450901:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaef9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020859776:12345-0@lo:400:kworker.0 Request processed in 2155us (2598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582014.450917:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788582014.451021:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020860160 00000100:00100000:2.0:1788582014.451030:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020860160 00000100:00100000:2.0:1788582014.451079:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020859904 00000100:00100000:2.0:1788582014.451082:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020859904 00000100:00100000:2.0:1788582014.451105:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788582014.451113:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020860160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582014.451173:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaef9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020860160:12345-0@lo:400:kworker.0 Request processed in 61us (2937us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582014.451179:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788582014.451191:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788582014.451197:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020859904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582014.451262:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaef8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020859904:12345-0@lo:400:kworker.0 Request processed in 65us (2883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582014.451268:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788582014.451289:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020860288 00000100:00100000:2.0:1788582014.451293:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020860288 00000100:00100000:2.0:1788582014.451319:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788582014.451325:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020860288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788582014.451352:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788582014.451395:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaefad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020860288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (3069us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582014.451401:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788582014.451462:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020859648:0@lo:400:kworker.0 00010000:00080000:2.0:1788582014.451479:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbaefb800 x1875464020860160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582014.451489:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaefb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020860160:0@lo:400:kworker.0 00000100:00100000:2.0:1788582014.451501:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaefa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020859520:0@lo:400:kworker.0 00000100:00100000:2.0:1788582014.451512:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020860032:0@lo:400:kworker.0 00000100:00080000:1.0:1788582014.455543:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788582014.455554:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788582014.455557:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788582014.456092:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020859776:0@lo:400:kworker.0 00010000:00080000:3.0:1788582014.456117:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0d90d13800 x1875464020860288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788582014.456152:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020860288:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788582014.456191:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbaefbb80 x1875464020859904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788582014.458361:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020859904:0@lo:400:kworker.0 00010000:00010000:1.0:1788582014.711699:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582015.732469:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582015.836745:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582015.836848:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582015.836973:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001954304 00000100:00100000:3.0:1788582015.836984:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001954304 00000100:00080000:1.0:1788582015.837132:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788582015.837199:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 49 00000100:00100000:3.0:1788582015.837256:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:2351:x1875464001954304:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582015.837352:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc5b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:2351:x1875464001954304:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 80us (596us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582015.837361:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 49 00000100:00100000:0.0:1788582015.837587:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001954176 00000100:00100000:0.0:1788582015.837593:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001954176 00000100:00100000:0.0:1788582015.837674:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 201 00000100:00100000:0.0:1788582015.837682:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2351:x1875464001954176:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582015.837721:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2351:x1875464001954176:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 39us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582015.837727:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 201 00000100:00100000:0.0:1788582015.984386:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788582015.984410:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020860416:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788582015.984479:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582015.984548:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020860416 00000100:00100000:0.0:1788582015.984556:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020860416 00000100:00100000:0.0:1788582015.984605:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788582015.984615:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020860416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788582015.984648:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582015.984693:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020860416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582015.984701:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788582015.984741:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbbd91c00 x1875464020860416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582031 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788582015.984759:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020860416:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788582016.749725:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582017.774720:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582018.813333:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582019.565687:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788582019.565750:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788582019.565788:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaefa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020860672:0@lo:400:kworker.0 00000100:00100000:0.0:1788582019.565869:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582019.567623:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020860672 00000100:00100000:3.0:1788582019.567638:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020860672 00000100:00100000:3.0:1788582019.567717:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788582019.567727:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020860672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582019.567807:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020860672:12345-0@lo:400:kworker.0 Request processed in 80us (1936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582019.567815:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788582019.569615:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788582019.569637:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020860800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788582019.569711:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582019.569770:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020860800 00000100:00100000:0.0:1788582019.569778:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020860800 00000100:00100000:0.0:1788582019.569843:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788582019.569853:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020860800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788582019.569888:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582019.569934:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd91500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020860800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582019.569941:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788582019.569989:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbbd93800 x1875464020860800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788582019.570008:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020860800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788582019.570043:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaefa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020860672:0@lo:400:kworker.0 00000100:00080000:0.0:1788582019.570076:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788582019.578890:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020860544:0@lo:400:kworker.0 00000100:00100000:1.0:1788582019.578986:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582019.579159:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020860544 00000100:00100000:3.0:1788582019.579167:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020860544 00000100:00100000:3.0:1788582019.579257:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788582019.579268:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3309:x1875464020860544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582019.579340:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3309:x1875464020860544:12345-0@lo:400:kworker.0 Request processed in 73us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582019.579349:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1788582019.579640:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020860544:0@lo:400:kworker.0 00000100:00100000:2.0:1788582019.579692:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaefb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875464020860928:0@lo:400:kworker.0 00000100:00100000:2.0:1788582019.579739:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582019.579748:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875464020861184:0@lo:400:kworker.0 00000100:00100000:0.0:1788582019.579776:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582019.579799:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788582019.579804:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020861056:0@lo:400:kworker.0 00000100:00100000:2.0:1788582019.579806:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020860928 00000100:00100000:2.0:1788582019.579810:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020860928 00000100:00100000:0.0:1788582019.579829:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582019.579845:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020861184 00000100:00100000:2.0:1788582019.579848:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020861184 00000100:00100000:2.0:1788582019.579864:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788582019.579866:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788582019.579870:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaefa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875464020860928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582019.579892:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020861056 00000100:00100000:0.0:1788582019.579896:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020861056 00000100:00100000:2.0:1788582019.579915:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaefa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875464020860928:12345-0@lo:400:kworker.0 Request processed in 45us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582019.579921:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788582019.579927:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788582019.579933:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020861056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582019.579935:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788582019.579940:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875464020861184:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788582019.580010:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788582019.580041:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875464020861184:12345-0@lo:400:kworker.0 Request processed in 26us (189us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582019.580048:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788582019.580081:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaefb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875464020860928:0@lo:400:kworker.0 00000100:00100000:0.0:1788582019.580478:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020861056:12345-0@lo:400:kworker.0 Request processed in 544us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582019.580485:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:1.0:1788582019.585402:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbaef8a80 x1875464020861056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582019.585423:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaef8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020861056:0@lo:400:kworker.0 00000100:00100000:1.0:1788582019.585440:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaef8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875464020861184:0@lo:400:kworker.0 00010000:00010000:3.0:1788582019.821693:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582020.847077:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582020.968121:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582020.968175:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582020.968301:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001954432 00000100:00100000:3.0:1788582020.968311:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001954432 00000100:00100000:3.0:1788582020.968377:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 203 00000100:00100000:3.0:1788582020.968388:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2352:x1875464001954432:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582020.968458:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2352:x1875464001954432:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 72us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582020.968466:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 203 00000100:00100000:2.0:1788582020.968789:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001954560 00000100:00100000:2.0:1788582020.968795:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001954560 00000100:00100000:2.0:1788582020.968856:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 53 00000100:00100000:2.0:1788582020.968865:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+6:2352:x1875464001954560:12345-192.168.201.12@tcp:400:kworker.0 00000100:00080000:1.0:1788582020.968935:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788582020.973502:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc58e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+6:2352:x1875464001954560:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 4627us (5313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582020.974447:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 53 00000100:00100000:3.0:1788582021.101432:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020861312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788582021.101507:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582021.101770:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020861312 00000100:00100000:0.0:1788582021.101779:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020861312 00000100:00100000:0.0:1788582021.101852:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788582021.101863:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020861312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788582021.101899:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582021.101952:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020861312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (445us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582021.101960:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:0.0:1788582021.102011:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbbd92d80 x1875464020861312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788582021.102030:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020861312:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788582021.102155:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1788582021.631446:0:10124:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 00:20:19 (1788582019) === 00010000:00010000:2.0:1788582021.874563:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582022.027956:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582022.028410:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001954688 00000100:00100000:2.0:1788582022.028421:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001954688 00000100:00100000:2.0:1788582022.028489:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 204 00000100:00100000:2.0:1788582022.028500:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:8113:x1875464001954688:12345-192.168.201.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788582022.028519:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582022.028537:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8138fe00/0x2bc3aa892c3a6c41 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9022 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582022.028588:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8138fe00/0x2bc3aa892c3a6c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9022 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582022.028600:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8138fe00/0x2bc3aa892c3a6c41 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9022 expref: 11 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582022.028610:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8138fe00, rc 0) 00000100:00100000:2.0:1788582022.028683:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+11:8113:x1875464001954688:12345-192.168.201.12@tcp:101:mount.lustre.0 Request processed in 184us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582022.028690:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 204 00000100:00100000:3.0:1788582022.043280:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582022.043342:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001954816 00000100:00100000:1.0:1788582022.043353:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001954816 00000100:00100000:1.0:1788582022.043412:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 205 00000100:00100000:1.0:1788582022.043423:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+11:8113:x1875464001954816:12345-192.168.201.12@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788582022.043717:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+11:8113:x1875464001954816:12345-192.168.201.12@tcp:501:mount.lustre.0 Request processed in 294us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582022.043725:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 205 00000100:00100000:1.0:1788582022.046534:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582022.046650:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001954944 00000100:00100000:3.0:1788582022.046661:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001954944 00000100:00100000:3.0:1788582022.046717:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 206 00000100:00100000:3.0:1788582022.046727:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+11:8113:x1875464001954944:12345-192.168.201.12@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788582022.047243:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+11:8113:x1875464001954944:12345-192.168.201.12@tcp:503:mount.lustre.0 Request processed in 477us (678us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582022.047252:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 206 00000100:00100000:2.0:1788582022.056997:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582022.057173:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001955072 00000100:00100000:1.0:1788582022.057184:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001955072 00000100:00100000:1.0:1788582022.057285:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 207 00000100:00100000:1.0:1788582022.057295:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3330850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+11:8117:x1875464001955072:12345-192.168.201.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788582022.057557:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3330850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+11:8117:x1875464001955072:12345-192.168.201.12@tcp:502:llog_process_th.0 Request processed in 263us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582022.057568:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 207 00000100:00100000:1.0:1788582022.075321:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582022.076358:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001955200 00000100:00100000:3.0:1788582022.076371:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001955200 00000100:00100000:3.0:1788582022.076434:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 208 00000100:00100000:3.0:1788582022.076444:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3331850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+11:8117:x1875464001955200:12345-192.168.201.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788582022.077113:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3331850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+11:8117:x1875464001955200:12345-192.168.201.12@tcp:502:llog_process_th.0 Request processed in 665us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582022.077123:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 208 00000100:00100000:3.0:1788582022.081279:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582022.081569:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001955328 00000100:00100000:2.0:1788582022.081581:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001955328 00000100:00100000:2.0:1788582022.081654:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 209 00000100:00100000:2.0:1788582022.081666:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+11:8113:x1875464001955328:12345-192.168.201.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788582022.081684:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582022.081703:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8138f600/0x2bc3aa892c3a6c48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c904c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582022.081735:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8138f600/0x2bc3aa892c3a6c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c904c expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582022.081747:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8138f600/0x2bc3aa892c3a6c48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c904c expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582022.081758:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8138f600, rc 0) 00000100:00100000:2.0:1788582022.082300:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:8113:x1875464001955328:12345-192.168.201.12@tcp:101:mount.lustre.0 Request processed in 634us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582022.082321:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 209 00000100:00100000:2.0:1788582022.084729:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582022.084817:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001955456 00000100:00100000:3.0:1788582022.084826:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001955456 00000100:00100000:3.0:1788582022.084924:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 210 00000100:00100000:3.0:1788582022.084935:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:8113:x1875464001955456:12345-192.168.201.12@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788582022.084963:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788582022.084989:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788582022.084993:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788582022.084997:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788582022.084999:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1788582022.087246:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:8113:x1875464001955456:12345-192.168.201.12@tcp:256:mount.lustre.0 Request processed in 2268us (2480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582022.087262:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 210 00000100:00100000:0.0:1788582022.090313:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582022.090351:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001955584 00000100:00100000:2.0:1788582022.090361:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001955584 00000100:00100000:2.0:1788582022.090413:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 211 00000100:00100000:2.0:1788582022.090423:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3330c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:8113:x1875464001955584:12345-192.168.201.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788582022.090441:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582022.090458:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8138f000/0x2bc3aa892c3a6c4f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9053 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582022.090485:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8138f000/0x2bc3aa892c3a6c4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9053 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582022.090493:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8138f000/0x2bc3aa892c3a6c4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9053 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582022.090500:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8138f000, rc 0) 00000100:00100000:2.0:1788582022.090547:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3330c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:8113:x1875464001955584:12345-192.168.201.12@tcp:101:mount.lustre.0 Request processed in 126us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582022.090554:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 211 00000100:00100000:2.0:1788582022.092917:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582022.093008:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001955712 00000100:00100000:3.0:1788582022.093018:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001955712 00000100:00100000:3.0:1788582022.093123:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 212 00000100:00100000:3.0:1788582022.093135:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3331050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:8113:x1875464001955712:12345-192.168.201.12@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788582022.093466:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3331050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:8113:x1875464001955712:12345-192.168.201.12@tcp:501:mount.lustre.0 Request processed in 333us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582022.093475:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 212 00000100:00100000:1.0:1788582022.095594:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582022.095790:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001955840 00000100:00100000:2.0:1788582022.095798:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001955840 00000100:00100000:2.0:1788582022.095839:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 213 00000100:00100000:2.0:1788582022.095845:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:8113:x1875464001955840:12345-192.168.201.12@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788582022.096026:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:8113:x1875464001955840:12345-192.168.201.12@tcp:503:mount.lustre.0 Request processed in 179us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582022.096040:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 213 00000100:00100000:0.0:1788582022.101576:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582022.101687:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001955968 00000100:00100000:3.0:1788582022.101698:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001955968 00000100:00100000:3.0:1788582022.101749:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 214 00000100:00100000:3.0:1788582022.101759:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3331450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:8121:x1875464001955968:12345-192.168.201.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788582022.102021:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3331450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:8121:x1875464001955968:12345-192.168.201.12@tcp:502:llog_process_th.0 Request processed in 262us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582022.102039:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 214 00000100:00100000:0.0:1788582022.106550:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582022.106808:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001956096 00000100:00100000:1.0:1788582022.106820:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001956096 00000100:00100000:1.0:1788582022.106922:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 215 00000100:00100000:1.0:1788582022.106934:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:8121:x1875464001956096:12345-192.168.201.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788582022.107257:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:8121:x1875464001956096:12345-192.168.201.12@tcp:502:llog_process_th.0 Request processed in 269us (659us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582022.107266:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 215 00000100:00100000:1.0:1788582022.111535:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582022.112874:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001956352 00000100:00100000:3.0:1788582022.112900:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001956352 00000100:00100000:0.0:1788582022.113312:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582022.113353:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001956224 00000100:00100000:3.0:1788582022.113357:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001956224 00000100:00100000:3.0:1788582022.113413:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 10 00000100:00100000:3.0:1788582022.113422:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2348:x1875464001956224:12345-192.168.201.12@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788582022.113452:0:5843:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 7a85b5d8-11d7-4e00-8094-5ec4da71e638@192.168.201.12@tcp t0 exp 0000000000000000 cur 241 last 0 00000100:00080000:1.0:1788582022.113483:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:3.0:1788582022.113492:0:5843:0:(genops.c:1385:class_connect()) connect: client 7a85b5d8-11d7-4e00-8094-5ec4da71e638, cookie 0x2bc3aa892c3a6c56 00000004:00100000:3.0:1788582022.113524:0:5843:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788582022.114258:0:5843:0:(import.c:65:import_set_state_nolock()) ffff8d0da7008800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788582022.114339:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a85b5d8-11d7-4e00-8094-5ec4da71e638+6:2348:x1875464001956224:12345-192.168.201.12@tcp:38:mount.lustre.0 Request processed in 916us (1028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582022.116463:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 10 00000100:00100000:3.0:1788582022.116508:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 54 00000100:00100000:3.0:1788582022.116521:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:2349:x1875464001956352:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582022.116524:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582022.116552:0:5844:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788582022.116595:0:5845:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788582022.116603:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc5aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:2349:x1875464001956352:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 88us (5076us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582022.116734:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 54 00000100:00100000:1.0:1788582022.119224:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582022.119318:0:5844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788582022.119486:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001956608 00000100:00100000:2.0:1788582022.119496:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001956608 00000100:00100000:2.0:1788582022.119560:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 11 00000100:00100000:2.0:1788582022.119571:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a85b5d8-11d7-4e00-8094-5ec4da71e638+6:8113:x1875464001956608:12345-192.168.201.12@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788582022.119764:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788582022.119857:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc59f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a85b5d8-11d7-4e00-8094-5ec4da71e638+6:8113:x1875464001956608:12345-192.168.201.12@tcp:41:mount.lustre.0 Request processed in 287us (3331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582022.119866:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 11 00000100:00100000:0.0:1788582022.120064:0:5845:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:3.0:1788582022.122163:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788582022.122977:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582022.123065:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001956480 00000100:00100000:2.0:1788582022.123075:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001956480 00000100:00100000:2.0:1788582022.123153:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001956736 00000100:00100000:2.0:1788582022.123157:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001956736 00000100:00100000:0.0:1788582022.123218:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 12 00000100:00100000:0.0:1788582022.123286:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a85b5d8-11d7-4e00-8094-5ec4da71e638+7:0:x1875464001956480:12345-192.168.201.12@tcp:41:mount.lustre.0 00000100:00100000:3.0:1788582022.123291:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 13 00000100:00100000:3.0:1788582022.123299:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a85b5d8-11d7-4e00-8094-5ec4da71e638+7:8113:x1875464001956736:12345-192.168.201.12@tcp:40:mount.lustre.0 00000004:00000024:0.0:1788582022.123316:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788582022.123371:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab902300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a85b5d8-11d7-4e00-8094-5ec4da71e638+7:8113:x1875464001956736:12345-192.168.201.12@tcp:40:mount.lustre.0 Request processed in 72us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582022.123387:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 13 00000100:00100000:0.0:1788582022.123475:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc58380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a85b5d8-11d7-4e00-8094-5ec4da71e638+6:0:x1875464001956480:12345-192.168.201.12@tcp:41:mount.lustre.0 Request processed in 247us (5044us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582022.123483:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 12 00000100:00100000:1.0:1788582022.125828:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582022.125864:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582022.125885:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001957120 00000100:00100000:0.0:1788582022.125894:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001957120 00000100:00100000:1.0:1788582022.125903:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582022.125937:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 1 00000100:00100000:1.0:1788582022.125945:0:5847:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:0.0:1788582022.125946:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a85b5d8-11d7-4e00-8094-5ec4da71e638+6:8113:x1875464001957120:12345-192.168.201.12@tcp:33:mount.lustre.0 00000100:00100000:1.0:1788582022.125951:0:5847:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000004:00200000:0.0:1788582022.126018:0:5846:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1788582022.126338:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:7a85b5d8-11d7-4e00-8094-5ec4da71e638+6:8113:x1875464001957120:12345-192.168.201.12@tcp:33:mount.lustre.0 Request processed in 391us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582022.126346:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 1 00000100:00100000:3.0:1788582022.127274:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001956864 00000100:00100000:3.0:1788582022.127283:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001956864 00000100:00100000:3.0:1788582022.127312:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001956992 00000100:00100000:3.0:1788582022.127316:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001956992 00000100:00100000:3.0:1788582022.127342:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 12 00000100:00100000:3.0:1788582022.127348:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab901880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875464001956864:12345-192.168.201.12@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788582022.127376:0:6692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 7a85b5d8-11d7-4e00-8094-5ec4da71e638@192.168.201.12@tcp t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:3.0:1788582022.127405:0:6692:0:(genops.c:1385:class_connect()) connect: client 7a85b5d8-11d7-4e00-8094-5ec4da71e638, cookie 0x2bc3aa892c3a6c5d 00002000:00100000:3.0:1788582022.127416:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 7a85b5d8-11d7-4e00-8094-5ec4da71e638/ffff8d0da700d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788582022.127427:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788582022.127650:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:1.0:1788582022.127777:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 13 00000100:00100000:1.0:1788582022.127783:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab903b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875464001956992:12345-192.168.201.12@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788582022.127802:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 7a85b5d8-11d7-4e00-8094-5ec4da71e638@192.168.201.12@tcp t0 exp 0000000000000000 cur 241 last 0 00000020:00000080:1.0:1788582022.127826:0:6693:0:(genops.c:1385:class_connect()) connect: client 7a85b5d8-11d7-4e00-8094-5ec4da71e638, cookie 0x2bc3aa892c3a6c64 00002000:00100000:1.0:1788582022.127832:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 7a85b5d8-11d7-4e00-8094-5ec4da71e638/ffff8d0dbf3cd800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788582022.127859:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788582022.127993:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788582022.128022:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8d0dbf3c9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788582022.128097:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab903b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a85b5d8-11d7-4e00-8094-5ec4da71e638+6:2348:x1875464001956992:12345-192.168.201.12@tcp:8:mount.lustre.0 Request processed in 312us (2192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582022.128105:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 13 00000100:00080000:3.0:1788582022.129157:0:6692:0:(import.c:65:import_set_state_nolock()) ffff8d0da700f800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788582022.129215:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab901880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a85b5d8-11d7-4e00-8094-5ec4da71e638+6:2348:x1875464001956864:12345-192.168.201.12@tcp:8:mount.lustre.0 Request processed in 1849us (3335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582022.129224:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 12 00010000:00010000:0.0:1788582022.893735:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582023.925272:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582024.686147:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020861440:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788582024.686261:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582024.686347:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020861440 00000100:00100000:0.0:1788582024.686356:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020861440 00000100:00100000:0.0:1788582024.686421:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788582024.686434:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020861440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788582024.686472:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582024.686517:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020861440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (256us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582024.686524:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1788582024.686564:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbbd91180 x1875464020861440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788582024.686593:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020861440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788582024.687247:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875464020861696:0@lo:400:kworker.0 00000100:00100000:2.0:1788582024.687284:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582024.687308:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788582024.687314:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaefb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020861568:0@lo:400:kworker.0 00000100:00100000:2.0:1788582024.687340:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582024.687362:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875464020862080:0@lo:400:kworker.0 00000100:00100000:2.0:1788582024.687381:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582024.687404:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020861568 00000100:00100000:2.0:1788582024.687409:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020861568 00000100:00100000:2.0:1788582024.687438:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788582024.687444:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3309:x1875464020861568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582024.687489:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3309:x1875464020861568:12345-0@lo:400:kworker.0 Request processed in 45us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582024.687496:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:2.0:1788582024.687530:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaefb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020861568:0@lo:400:kworker.0 00000100:00080000:3.0:1788582024.687912:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788582024.688063:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020861696 00000100:00100000:3.0:1788582024.688068:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020861696 00000100:00100000:3.0:1788582024.688101:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020862080 00000100:00100000:3.0:1788582024.688104:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020862080 00000100:00100000:3.0:1788582024.688126:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788582024.688132:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875464020861696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582024.688228:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaef8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875464020861696:12345-0@lo:400:kworker.0 Request processed in 59us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582024.688234:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788582024.688258:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788582024.688265:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875464020862080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582024.688360:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaef8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875464020862080:12345-0@lo:400:kworker.0 Request processed in 95us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582024.688367:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1788582024.688400:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788582024.688851:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875464020862080:0@lo:400:kworker.0 00000100:00100000:3.0:1788582024.688861:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875464020861696:0@lo:400:kworker.0 00000100:00100000:0.0:1788582024.689237:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020861824:0@lo:400:kworker.0 00000100:00100000:0.0:1788582024.689275:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582024.689494:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788582024.689502:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020861952:0@lo:400:kworker.0 00000100:00100000:0.0:1788582024.689530:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582024.689691:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020861824 00000100:00100000:3.0:1788582024.689696:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020861824 00000100:00100000:3.0:1788582024.689812:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788582024.689819:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020861824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582024.689871:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020861824:12345-0@lo:400:kworker.0 Request processed in 52us (595us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582024.689878:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1788582024.689895:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788582024.689980:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020861952 00000100:00100000:2.0:1788582024.689984:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020861952 00000100:00100000:2.0:1788582024.690029:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788582024.690035:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020861952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582024.690069:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020861952:12345-0@lo:400:kworker.0 Request processed in 33us (538us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582024.690087:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1788582024.690274:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbaef9500 x1875464020861952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582024.690295:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020861952:0@lo:400:kworker.0 00000100:00100000:2.0:1788582024.690306:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020861824:0@lo:400:kworker.0 00000100:00080000:3.0:1788582024.690408:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788582024.942370:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788582025.266362:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7a85b5d8-11d7-4e00-8094-5ec4da71e638 00000001:00100000:1.0:1788582025.266831:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7a85b5d8-11d7-4e00-8094-5ec4da71e638 00010000:00010000:0.0:1788582025.968522:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582026.221434:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788582026.221460:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020862208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788582026.221545:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582026.221780:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020862208 00000100:00100000:0.0:1788582026.221789:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020862208 00000100:00100000:0.0:1788582026.221862:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788582026.221872:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab900700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020862208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788582026.221907:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582026.221958:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab900700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020862208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582026.221964:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1788582026.222004:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbbd92300 x1875464020862208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788582026.222022:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020862208:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788582026.222088:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788582026.990192:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788582027.281502:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a85b5d8-11d7-4e00-8094-5ec4da71e638 00000001:02000400:2.0:1788582027.494720:0:10324:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg112-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1788582027.617461:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582027.617514:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582027.617548:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582027.617572:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582027.617595:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582027.617620:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001957760 00000100:00100000:1.0:1788582027.617628:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001957760 00000100:00100000:3.0:1788582027.617687:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001957248 00000100:00100000:1.0:1788582027.617693:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001957632 00000100:00100000:3.0:1788582027.617694:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001957248 00000100:00100000:1.0:1788582027.617699:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001957632 00000100:00100000:1.0:1788582027.617747:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 28 00000100:00100000:3.0:1788582027.617757:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 217 00000100:00100000:1.0:1788582027.617761:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab900e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2351:x1875464001957760:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582027.617771:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2351:x1875464001957248:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582027.617841:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001957504 00000100:00100000:0.0:1788582027.617846:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001957504 00000100:00100000:0.0:1788582027.617873:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001957376 00000100:00100000:0.0:1788582027.617875:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001957376 00000100:00100000:0.0:1788582027.617893:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 58 00000100:00100000:0.0:1788582027.617900:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2351:x1875464001957504:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582027.617976:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2351:x1875464001957248:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 208us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582027.617985:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 217 00000100:00100000:3.0:1788582027.618022:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 59 00000100:00100000:3.0:1788582027.618029:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+6:2351:x1875464001957376:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582027.618077:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab902a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+6:2351:x1875464001957376:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 48us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582027.618083:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 59 00000100:00100000:3.0:1788582027.618106:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 29 00000100:00100000:3.0:1788582027.618113:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab901f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2351:x1875464001957632:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582027.618137:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab901f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2351:x1875464001957632:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 25us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582027.618155:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 29 00000100:00100000:1.0:1788582027.620048:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab900e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2351:x1875464001957760:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 2283us (2489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582027.620061:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 28 00000100:00100000:0.0:1788582027.623403:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab903800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2351:x1875464001957504:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 5489us (5875us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582027.623436:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 58 00000100:00080000:0.0:1788582027.627607:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788582027.627620:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788582027.627625:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788582028.013816:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582029.038413:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582029.808418:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020862336:0@lo:400:kworker.0 00000100:00100000:2.0:1788582029.808503:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582029.808549:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020862848:0@lo:400:kworker.0 00000100:00100000:2.0:1788582029.808577:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582029.808614:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788582029.808620:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020862464:0@lo:400:kworker.0 00000100:00100000:2.0:1788582029.808644:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582029.808661:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020862976:0@lo:400:kworker.0 00000100:00100000:2.0:1788582029.808683:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582029.808709:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaefb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020862592:0@lo:400:kworker.0 00000100:00100000:2.0:1788582029.808730:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582029.808747:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788582029.808752:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020862720:0@lo:400:kworker.0 00000100:00100000:2.0:1788582029.808785:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582029.808819:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020862336 00000100:00100000:2.0:1788582029.808827:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020862336 00000100:00100000:2.0:1788582029.808874:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788582029.808884:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3333450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3306:x1875464020862336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582029.808930:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3333450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3306:x1875464020862336:12345-0@lo:400:kworker.0 Request processed in 48us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582029.808936:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788582029.808967:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020862848 00000100:00100000:2.0:1788582029.808970:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020862848 00000100:00100000:2.0:1788582029.809004:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020862464 00000100:00100000:2.0:1788582029.809007:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020862464 00000100:00100000:2.0:1788582029.809022:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020862592 00000100:00100000:2.0:1788582029.809025:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020862592 00000100:00100000:2.0:1788582029.809039:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788582029.809045:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020862848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582029.809079:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020862848:12345-0@lo:400:kworker.0 Request processed in 34us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582029.809085:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788582029.809116:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788582029.809123:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020862464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582029.809152:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020862464:12345-0@lo:400:kworker.0 Request processed in 30us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582029.809157:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788582029.809167:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788582029.809173:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020862592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582029.809199:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020862592:12345-0@lo:400:kworker.0 Request processed in 26us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582029.809222:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788582029.809239:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020862976 00000100:00100000:2.0:1788582029.809243:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020862976 00000100:00100000:2.0:1788582029.809265:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020862720 00000100:00100000:2.0:1788582029.809267:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020862720 00000100:00100000:2.0:1788582029.809282:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788582029.809286:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020862976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582029.809312:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020862976:12345-0@lo:400:kworker.0 Request processed in 25us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582029.809317:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788582029.809326:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788582029.809331:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020862720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582029.809350:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020862720:12345-0@lo:400:kworker.0 Request processed in 20us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582029.809355:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788582029.809390:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020862464:0@lo:400:kworker.0 00010000:00080000:2.0:1788582029.809401:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0d9dd97480 x1875464020862976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582029.809418:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd97480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020862976:0@lo:400:kworker.0 00000100:00100000:2.0:1788582029.809426:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaef9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020862336:0@lo:400:kworker.0 00000100:00100000:2.0:1788582029.809433:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020862848:0@lo:400:kworker.0 00000100:00080000:2.0:1788582029.809456:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788582029.809460:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788582029.809462:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788582029.809480:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbaefbb80 x1875464020862720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582029.809490:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaefbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020862720:0@lo:400:kworker.0 00000100:00100000:2.0:1788582029.809499:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaefb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020862592:0@lo:400:kworker.0 00000100:00100000:2.0:1788582029.813472:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788582029.813505:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020863104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788582029.813703:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582029.813752:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020863104 00000100:00100000:2.0:1788582029.813760:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020863104 00000100:00100000:2.0:1788582029.813808:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788582029.813818:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020863104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788582029.813851:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788582029.813890:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020863104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582029.813897:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:2.0:1788582029.813934:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbf2d9c00 x1875464020863104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582029.813968:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020863104:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788582030.067368:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582031.087325:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582031.345280:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788582031.345317:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020863232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788582031.345388:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582031.345459:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020863232 00000100:00100000:1.0:1788582031.345480:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020863232 00000100:00100000:1.0:1788582031.345537:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788582031.345547:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab902d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020863232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788582031.345582:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788582031.345630:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab902d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020863232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582031.345638:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1788582031.345661:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788582031.345692:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dab901180 x1875464020863232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582031.345711:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020863232:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788582032.109502:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788582032.743878:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582032.743929:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582032.744023:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582032.744079:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582032.744130:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001958400 00000100:00100000:1.0:1788582032.744149:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001958400 00000100:00100000:1.0:1788582032.744251:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 32 00000100:00100000:1.0:1788582032.744263:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2350:x1875464001958400:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582032.744346:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2350:x1875464001958400:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 86us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582032.744353:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 32 00000100:00080000:1.0:1788582032.744378:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788582032.744726:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001957888 00000100:00100000:2.0:1788582032.744733:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001957888 00000100:00100000:2.0:1788582032.744772:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 219 00000100:00100000:2.0:1788582032.744780:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2350:x1875464001957888:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788582032.744817:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2350:x1875464001957888:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 39us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582032.744824:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 219 00000100:00100000:1.0:1788582032.751195:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582032.751893:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001958272 00000100:00100000:3.0:1788582032.751903:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001958272 00000100:00100000:3.0:1788582032.751987:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 33 00000100:00100000:3.0:1788582032.751999:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab901180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2350:x1875464001958272:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582032.752096:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab901180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2350:x1875464001958272:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 100us (912us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582032.752104:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 33 00000100:00080000:1.0:1788582032.752380:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788582032.753934:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001958144 00000100:00100000:0.0:1788582032.753947:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001958144 00000100:00100000:0.0:1788582032.754156:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001958016 00000100:00100000:0.0:1788582032.754161:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001958016 00000100:00100000:2.0:1788582032.754230:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 63 00000100:00100000:2.0:1788582032.754241:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2350:x1875464001958144:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788582032.754318:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2350:x1875464001958144:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 79us (10387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582032.754325:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 63 00000100:00080000:1.0:1788582032.755363:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788582032.756034:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 64 00000100:00100000:0.0:1788582032.756048:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+6:2350:x1875464001958016:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582032.756126:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+6:2350:x1875464001958016:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 82us (12073us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582032.756133:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 64 00010000:00010000:3.0:1788582033.133841:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582034.157794:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582034.926425:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020863360:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788582034.926505:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582034.927325:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020863360 00000100:00100000:1.0:1788582034.927335:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020863360 00000100:00100000:1.0:1788582034.929290:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788582034.929306:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020863360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788582034.929346:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788582034.929447:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020863360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 137us (2933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582034.929456:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1788582034.929515:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbf2d9c00 x1875464020863360/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582034.929537:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020863360:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788582034.929637:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020863616:0@lo:400:kworker.0 00000100:00100000:1.0:1788582034.929674:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582034.929701:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788582034.929707:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab901c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020863744:0@lo:400:kworker.0 00000100:00100000:1.0:1788582034.929728:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582034.929759:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020863616 00000100:00100000:1.0:1788582034.929765:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020863616 00000100:00100000:1.0:1788582034.929795:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020863744 00000100:00100000:1.0:1788582034.929798:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020863744 00000100:00080000:2.0:1788582034.932624:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788582034.932635:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788582034.932864:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788582034.932878:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020863616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582034.932975:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab903480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020863616:12345-0@lo:400:kworker.0 Request processed in 102us (3299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582034.932983:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788582034.933001:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788582034.933009:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020863744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582034.933050:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab900380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020863744:12345-0@lo:400:kworker.0 Request processed in 42us (3319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582034.933067:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788582034.933103:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020863488:0@lo:400:kworker.0 00000100:00100000:1.0:1788582034.933147:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582034.933179:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875464020864000:0@lo:400:kworker.0 00000100:00100000:1.0:1788582034.933240:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582034.933388:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020863488 00000100:00100000:2.0:1788582034.933396:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020863488 00000100:00100000:2.0:1788582034.933561:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788582034.933570:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3307:x1875464020863488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582034.933606:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3307:x1875464020863488:12345-0@lo:400:kworker.0 Request processed in 38us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582034.933613:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:2.0:1788582034.933651:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020864000 00000100:00100000:2.0:1788582034.933655:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020864000 00000100:00100000:2.0:1788582034.933683:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788582034.933688:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875464020864000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582034.933716:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875464020864000:12345-0@lo:400:kworker.0 Request processed in 28us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582034.933722:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1788582034.933737:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788582034.934698:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab903100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020863872:0@lo:400:kworker.0 00000100:00100000:0.0:1788582034.934747:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582034.934854:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875464020864000:0@lo:400:kworker.0 00000100:00100000:1.0:1788582034.934878:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab900000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020863488:0@lo:400:kworker.0 00000100:00100000:1.0:1788582034.934899:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab901c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020863744:0@lo:400:kworker.0 00000100:00100000:1.0:1788582034.934909:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020863616:0@lo:400:kworker.0 00000100:00100000:2.0:1788582034.934974:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020863872 00000100:00100000:2.0:1788582034.934980:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020863872 00000100:00080000:1.0:1788582034.935078:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788582034.935799:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788582034.935812:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020863872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582034.935886:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd92300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020863872:12345-0@lo:400:kworker.0 Request processed in 79us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582034.935893:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788582034.936711:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dab903100 x1875464020863872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788582034.936745:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab903100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020863872:0@lo:400:kworker.0 00010000:00010000:0.0:1788582035.181371:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582036.205834:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582036.461326:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788582036.461349:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020864128:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788582036.461418:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582036.461487:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020864128 00000100:00100000:1.0:1788582036.461496:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020864128 00000100:00100000:1.0:1788582036.461553:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788582036.461564:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020864128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788582036.461608:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788582036.461655:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020864128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582036.461662:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1788582036.461682:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788582036.461709:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbf2dc700 x1875464020864128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582052 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582036.461744:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020864128:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788582037.229347:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582037.865945:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582037.869192:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582037.869251:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582037.869291:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582037.869320:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582037.870223:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001958784 00000100:00100000:0.0:1788582037.870235:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001958784 00000100:00100000:0.0:1788582037.870297:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001958656 00000100:00100000:0.0:1788582037.870300:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001958656 00000100:00100000:0.0:1788582037.870328:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 68 00000100:00100000:0.0:1788582037.870337:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2352:x1875464001958784:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582037.870427:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2352:x1875464001958784:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 91us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582037.870435:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 68 00000100:00100000:0.0:1788582037.870466:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 69 00000100:00100000:0.0:1788582037.870472:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+6:2352:x1875464001958656:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582037.870496:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+6:2352:x1875464001958656:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 25us (1205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582037.870503:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 69 00000100:00100000:0.0:1788582037.873604:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001959040 00000100:00100000:0.0:1788582037.873617:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001959040 00000100:00100000:0.0:1788582037.873677:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001958912 00000100:00100000:0.0:1788582037.873680:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001958912 00000100:00100000:0.0:1788582037.873709:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 35 00000100:00100000:0.0:1788582037.873720:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2352:x1875464001959040:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582037.873814:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2352:x1875464001959040:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 95us (4562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582037.873820:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 35 00000100:00100000:0.0:1788582037.873837:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 36 00000100:00100000:0.0:1788582037.873843:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2352:x1875464001958912:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582037.873866:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2352:x1875464001958912:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 24us (4546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582037.873872:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 36 00000100:00100000:3.0:1788582037.877913:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001958528 00000100:00100000:3.0:1788582037.877928:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001958528 00000100:00100000:3.0:1788582037.878156:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 221 00000100:00100000:3.0:1788582037.878168:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3332c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2352:x1875464001958528:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582037.878275:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3332c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2352:x1875464001958528:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 109us (12341us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582037.878282:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 221 00000100:00080000:0.0:1788582037.879262:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788582037.879270:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788582037.879273:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788582038.257672:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582039.278701:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582040.045373:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020864256:0@lo:400:kworker.0 00000100:00100000:1.0:1788582040.045446:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582040.045483:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875464020864768:0@lo:400:kworker.0 00000100:00100000:1.0:1788582040.045506:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582040.045530:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788582040.045537:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020864640:0@lo:400:kworker.0 00000100:00100000:1.0:1788582040.045561:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582040.045591:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020864384:0@lo:400:kworker.0 00000100:00100000:1.0:1788582040.045613:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582040.045628:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020864896:0@lo:400:kworker.0 00000100:00100000:1.0:1788582040.045642:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582040.045653:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788582040.045656:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020864512:0@lo:400:kworker.0 00000100:00100000:1.0:1788582040.045667:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582040.045688:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020864256 00000100:00100000:1.0:1788582040.045694:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020864256 00000100:00100000:1.0:1788582040.045729:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788582040.045736:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3309:x1875464020864256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582040.045780:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3309:x1875464020864256:12345-0@lo:400:kworker.0 Request processed in 44us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582040.045785:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:1.0:1788582040.045807:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020864768 00000100:00100000:1.0:1788582040.045810:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020864768 00000100:00100000:1.0:1788582040.045830:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020864384 00000100:00100000:1.0:1788582040.045832:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020864384 00000100:00100000:1.0:1788582040.045842:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020864512 00000100:00100000:1.0:1788582040.045843:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020864512 00000100:00100000:1.0:1788582040.045851:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788582040.045855:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875464020864768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582040.045875:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875464020864768:12345-0@lo:400:kworker.0 Request processed in 20us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582040.045879:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788582040.045886:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788582040.045889:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020864384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582040.045905:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020864384:12345-0@lo:400:kworker.0 Request processed in 15us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582040.045908:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788582040.045914:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788582040.045918:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020864512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582040.045950:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020864512:12345-0@lo:400:kworker.0 Request processed in 30us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582040.045956:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788582040.045973:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020864640 00000100:00100000:1.0:1788582040.045977:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020864640 00000100:00100000:1.0:1788582040.046128:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020864896 00000100:00100000:1.0:1788582040.046135:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020864896 00000100:00100000:1.0:1788582040.046157:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788582040.046161:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020864640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582040.046183:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020864640:12345-0@lo:400:kworker.0 Request processed in 23us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582040.046187:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788582040.046193:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788582040.046196:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020864896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582040.046233:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020864896:12345-0@lo:400:kworker.0 Request processed in 36us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582040.046236:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788582040.046277:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020864512:0@lo:400:kworker.0 00000100:00100000:1.0:1788582040.046283:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020864384:0@lo:400:kworker.0 00010000:00080000:1.0:1788582040.046290:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbf2df100 x1875464020864896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582040.046297:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020864896:0@lo:400:kworker.0 00010000:00080000:1.0:1788582040.046429:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbf2dd500 x1875464020864640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582040.046436:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020864640:0@lo:400:kworker.0 00000100:00100000:1.0:1788582040.046441:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2dd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020864256:0@lo:400:kworker.0 00000100:00100000:1.0:1788582040.046447:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875464020864768:0@lo:400:kworker.0 00000100:00080000:0.0:1788582040.046554:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788582040.046558:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788582040.046560:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788582040.046606:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020865024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788582040.046629:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582040.051940:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020865024 00000100:00100000:0.0:1788582040.051960:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020865024 00000100:00100000:0.0:1788582040.052046:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788582040.052057:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020865024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788582040.052097:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582040.052224:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020865024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 168us (5592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582040.052231:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1788582040.052278:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0d91a0a680 x1875464020865024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788582040.052299:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020865024:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788582040.306434:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582041.325455:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788582041.586788:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020865152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788582041.586869:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582041.587081:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020865152 00000100:00100000:0.0:1788582041.587089:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020865152 00000100:00100000:0.0:1788582041.587144:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788582041.587154:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020865152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788582041.587189:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582041.587263:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020865152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582041.587270:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1788582041.587325:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0d91a0a680 x1875464020865152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582057 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788582041.587343:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020865152:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788582042.349357:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582042.973569:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582042.973601:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582042.973622:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582042.973644:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582042.973666:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582042.973688:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001959168 00000100:00100000:2.0:1788582042.973696:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001959168 00000100:00100000:2.0:1788582042.973738:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 223 00000100:00100000:2.0:1788582042.973747:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2349:x1875464001959168:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788582042.973812:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2349:x1875464001959168:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 67us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582042.973820:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 223 00000100:00100000:2.0:1788582042.973851:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001959552 00000100:00100000:2.0:1788582042.973855:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001959552 00000100:00100000:2.0:1788582042.973898:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001959680 00000100:00100000:2.0:1788582042.973901:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001959680 00000100:00100000:2.0:1788582042.973922:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 14 00000100:00100000:2.0:1788582042.973928:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2348:x1875464001959552:12345-192.168.201.12@tcp:9:kworker.0 00000020:00000080:2.0:1788582042.973948:0:6692:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6c5d 00000100:00080000:2.0:1788582042.973957:0:6692:0:(import.c:65:import_set_state_nolock()) ffff8d0da700f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788582042.973992:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788582042.974330:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a85b5d8-11d7-4e00-8094-5ec4da71e638+2:2348:x1875464001959552:12345-192.168.201.12@tcp:9:kworker.0 Request processed in 400us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582042.974338:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 14 00000100:00100000:2.0:1788582042.974350:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 15 00000100:00100000:2.0:1788582042.974357:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2348:x1875464001959680:12345-192.168.201.12@tcp:9:kworker.0 00000020:00000080:2.0:1788582042.974369:0:6692:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6c64 00000100:00080000:2.0:1788582042.974374:0:6692:0:(import.c:65:import_set_state_nolock()) ffff8d0dbf3c9800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788582042.974395:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788582042.974621:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:7a85b5d8-11d7-4e00-8094-5ec4da71e638+2:2348:x1875464001959680:12345-192.168.201.12@tcp:9:kworker.0 Request processed in 263us (975us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582042.974629:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 15 00000100:00100000:2.0:1788582042.974649:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001959424 00000100:00100000:2.0:1788582042.974654:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001959424 00000100:00100000:2.0:1788582042.974686:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001959296 00000100:00100000:2.0:1788582042.974696:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001959296 00000100:00100000:2.0:1788582042.974725:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 73 00000100:00100000:2.0:1788582042.974732:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2349:x1875464001959424:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788582042.974760:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2349:x1875464001959424:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 29us (1137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582042.974768:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 73 00000100:00100000:2.0:1788582042.974781:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 74 00000100:00100000:2.0:1788582042.974787:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+6:2349:x1875464001959296:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788582042.974806:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+6:2349:x1875464001959296:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 20us (1139us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582042.974812:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 74 00000100:00080000:2.0:1788582042.974974:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788582042.974978:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788582042.974981:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788582042.974995:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582042.975001:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582043.373320:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582044.397302:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788582044.429788:0:11023:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788582045.165393:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788582045.165415:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d91a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020865280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788582045.165481:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582045.165540:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020865280 00000100:00100000:0.0:1788582045.165560:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020865280 00000100:00100000:0.0:1788582045.165638:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788582045.165648:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7721180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020865280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788582045.165682:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582045.165727:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7721180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020865280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582045.165734:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788582045.165756:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788582045.165782:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0d91a0a680 x1875464020865280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788582045.165799:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d91a0a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020865280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788582045.171288:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020865408:0@lo:400:kworker.0 00000100:00100000:1.0:1788582045.171358:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582045.171467:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020865408 00000100:00100000:2.0:1788582045.171475:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020865408 00000100:00100000:2.0:1788582045.171526:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788582045.171535:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3306:x1875464020865408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582045.171588:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3306:x1875464020865408:12345-0@lo:400:kworker.0 Request processed in 54us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582045.171595:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788582045.171654:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020865408:0@lo:400:kworker.0 00000100:00100000:3.0:1788582045.171970:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020865664:0@lo:400:kworker.0 00000100:00100000:3.0:1788582045.172002:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582045.172033:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788582045.172039:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020865792:0@lo:400:kworker.0 00000100:00100000:3.0:1788582045.172062:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582045.172090:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020865664 00000100:00100000:3.0:1788582045.172094:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020865664 00000100:00100000:3.0:1788582045.172133:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788582045.172139:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020865664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582045.172176:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020865664:12345-0@lo:400:kworker.0 Request processed in 36us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582045.172181:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788582045.172230:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020865792 00000100:00100000:3.0:1788582045.172234:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020865792 00000100:00100000:3.0:1788582045.172261:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788582045.172267:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020865792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582045.172298:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020865792:12345-0@lo:400:kworker.0 Request processed in 31us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582045.172304:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1788582045.172319:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788582045.172324:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788582045.172352:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dabdd1880 x1875464020865792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788582045.172364:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020865792:0@lo:400:kworker.0 00000100:00100000:3.0:1788582045.172374:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020865664:0@lo:400:kworker.0 00000100:00100000:1.0:1788582045.172440:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020865920:0@lo:400:kworker.0 00000100:00100000:1.0:1788582045.172467:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582045.172495:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788582045.172501:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020865536:0@lo:400:kworker.0 00000100:00100000:1.0:1788582045.172521:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582045.172606:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020865920 00000100:00100000:2.0:1788582045.172610:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020865920 00000100:00100000:2.0:1788582045.172893:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020865536 00000100:00100000:2.0:1788582045.172897:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020865536 00000100:00100000:2.0:1788582045.172918:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788582045.172924:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020865920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582045.172964:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020865920:12345-0@lo:400:kworker.0 Request processed in 40us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582045.172971:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788582045.172983:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788582045.172989:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020865536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582045.173016:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020865536:12345-0@lo:400:kworker.0 Request processed in 28us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582045.173022:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788582045.173049:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020865536:0@lo:400:kworker.0 00000100:00100000:2.0:1788582045.173058:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020865920:0@lo:400:kworker.0 00000100:00080000:3.0:1788582045.174054:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788582045.421389:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788582045.789570:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 7a85b5d8-11d7-4e00-8094-5ec4da71e638 00000020:00000080:3.0:1788582045.789578:0:7648:0:(genops.c:885:class_export_put()) final put ffff8d0dbf3cd800/7a85b5d8-11d7-4e00-8094-5ec4da71e638 00000020:00000080:3.0:1788582045.789602:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dbf3cd800/7a85b5d8-11d7-4e00-8094-5ec4da71e638 for lustre-OST0001 00000020:00000080:3.0:1788582045.789639:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d0dbf3c9800 for lustre-OST0001 00010000:00010000:2.0:1788582046.446543:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582046.701837:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020866048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788582046.701923:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582046.702088:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020866048 00000100:00100000:0.0:1788582046.702096:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020866048 00000100:00100000:0.0:1788582046.702164:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788582046.702175:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020866048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788582046.702362:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582046.702415:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020866048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 242us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582046.702421:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788582046.702809:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0db7723100 x1875464020866048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582062 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582046.702838:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020866048:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788582047.471053:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788582047.569339:0:11171:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc0d63e7d0 20000000:00000080:2.0:1788582047.569450:0:11171:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d0dbf3a1c00 uarg=0000000000000000 20000000:01000000:2.0:1788582047.569536:0:11171:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788582047.569542:0:11171:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788582047.569547:0:11171:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788582047.571714:0:11172:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788582047.571870:0:11171:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788582047.579788:0:11171:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788582047.579831:0:11171:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d0dbbe05e00/0x2bc3aa892c3a6c6b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582047.579852:0:11171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0da7088200/0x2bc3aa892c3a6c10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c901b expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582047.579861:0:11171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d8138ee00/0x2bc3aa892c3a6c1e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6c17 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582047.579867:0:11171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d8167d800/0x2bc3aa892c3a6c2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6c25 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582047.579874:0:11171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a6c3a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6c33 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582047.579881:0:11171:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d8138f000/0x2bc3aa892c3a6c4f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9053 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582047.579888:0:11171:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d0dbbe05e00/0x2bc3aa892c3a6c6b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582047.579934:0:11171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d8138f000/0x2bc3aa892c3a6c4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9053 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582047.579950:0:11171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d0d8138f000/0x2bc3aa892c3a6c4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9053 expref: 12 pid: 5836 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582047.579984:0:11171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2dbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1875464020866176:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582047.580149:0:11171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a6c3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a6c33 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582047.580158:0:11171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a6c3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c33 expref: 18 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582047.580167:0:11171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2d8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1875464020866304:0@lo:104: 00000100:00100000:2.0:1788582047.580368:0:11171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788582047.580426:0:11171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d8167d800/0x2bc3aa892c3a6c2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a6c25 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582047.580435:0:11171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d8167d800/0x2bc3aa892c3a6c2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c25 expref: 18 pid: 5838 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582047.580443:0:11171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2d8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1875464020866432:0@lo:104: 00000100:00100000:2.0:1788582047.580464:0:11171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788582047.580489:0:11171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d8138ee00/0x2bc3aa892c3a6c1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a6c17 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582047.580496:0:11171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d8138ee00/0x2bc3aa892c3a6c1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c17 expref: 18 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582047.580505:0:11171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2d9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1875464020866560:0@lo:104: 00000100:00100000:2.0:1788582047.580525:0:11171:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788582047.580541:0:11171:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0da7088200/0x2bc3aa892c3a6c10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c901b expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582047.580562:0:11171:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d0da7088200/0x2bc3aa892c3a6c10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c901b expref: 12 pid: 5838 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582047.580572:0:11171:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2dad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1875464020866688:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582047.580595:0:11171:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85b42600 going to sleep for 11 seconds 00000100:00100000:1.0:1788582047.580718:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020866304 00000100:00100000:1.0:1788582047.580726:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020866304 00000100:00100000:1.0:1788582047.580764:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020866432 00000100:00100000:1.0:1788582047.580766:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020866432 00000100:00100000:1.0:1788582047.580777:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020866560 00000100:00100000:1.0:1788582047.580780:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020866560 00000100:00100000:1.0:1788582047.580793:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788582047.580811:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+5:11171:x1875464020866304:12345-0@lo:104: 00010000:00010000:1.0:1788582047.580822:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0da7089c00/0x2bc3aa892c3a6c33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6c3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582047.580884:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788582047.580890:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2db800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+5:11171:x1875464020866304:12345-0@lo:104: Request processed in 90us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582047.580897:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788582047.580914:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788582047.580920:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+4:11171:x1875464020866432:12345-0@lo:104: 00010000:00010000:1.0:1788582047.580927:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6c2c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582047.580959:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788582047.580970:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+4:11171:x1875464020866432:12345-0@lo:104: Request processed in 50us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582047.580976:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788582047.580987:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788582047.580992:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:11171:x1875464020866560:12345-0@lo:104: 00010000:00010000:1.0:1788582047.580998:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d8167da00/0x2bc3aa892c3a6c17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6c1e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582047.581030:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788582047.581035:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:11171:x1875464020866560:12345-0@lo:104: Request processed in 43us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582047.581040:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1788582047.581055:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788582047.581061:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0da7089c00/0x2bc3aa892c3a6c33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6c3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582047.581069:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089c00 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:1.0:1788582047.581073:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0da7089c00/0x2bc3aa892c3a6c33 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a6c3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582047.581081:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0da7089c00/0x2bc3aa892c3a6c33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a6c3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788582047.581089:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0da7089c00/0x2bc3aa892c3a6c33 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a6c3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788582047.581095:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788582047.581121:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0da7089c00/0x2bc3aa892c3a6c33 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6c3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582047.581137:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788582047.581154:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0da7089c00/0x2bc3aa892c3a6c33 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6c3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582047.581160:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0da7089c00/0x2bc3aa892c3a6c33 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6c3a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582047.581174:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788582047.581178:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6c2c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582047.581184:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8167d400 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:1.0:1788582047.581227:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a6c2c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582047.581234:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a6c2c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788582047.581241:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a6c2c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788582047.581246:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788582047.581259:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6c2c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582047.581265:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788582047.581271:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c25 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6c2c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582047.581277:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6c2c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582047.581293:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788582047.581296:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d8167da00/0x2bc3aa892c3a6c17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6c1e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582047.581302:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8167da00 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:1.0:1788582047.581305:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8167da00/0x2bc3aa892c3a6c17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a6c1e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582047.581311:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d8167da00/0x2bc3aa892c3a6c17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a6c1e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788582047.581317:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8167da00/0x2bc3aa892c3a6c17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a6c1e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788582047.581323:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788582047.581333:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d8167da00/0x2bc3aa892c3a6c17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6c1e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582047.581339:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788582047.581353:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d8167da00/0x2bc3aa892c3a6c17 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6c1e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582047.581360:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d8167da00/0x2bc3aa892c3a6c17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6c1e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582047.581373:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582047.581375:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582047.581376:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582047.581383:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582047.581412:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020867072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788582047.581443:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582047.581750:0:11171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2d8700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1875464020866304:0@lo:104: 00000100:00100000:2.0:1788582047.581760:0:11171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2d8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1875464020866432:0@lo:104: 00000100:00100000:2.0:1788582047.581767:0:11171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2d9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1875464020866560:0@lo:104: 00010000:00010000:0.0:1788582047.582131:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788582047.582737:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020866944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788582047.582778:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582047.582825:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788582047.582831:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020866816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788582047.582852:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582047.582880:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020867072 00000100:00100000:3.0:1788582047.582886:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020867072 00010000:00010000:3.0:1788582047.582924:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d8138ee00/0x2bc3aa892c3a6c1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c17 expref: 19 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582047.582946:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020866944 00000100:00100000:3.0:1788582047.582950:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020866944 00010000:00010000:3.0:1788582047.582961:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d8167d800/0x2bc3aa892c3a6c2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c25 expref: 20 pid: 5838 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582047.582971:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020866816 00000100:00100000:3.0:1788582047.582975:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020866816 00010000:00010000:3.0:1788582047.582985:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a6c3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c33 expref: 21 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582047.582998:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788582047.583005:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d86673850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+21:3306:x1875464020867072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788582047.583017:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582047.583023:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d8138ee00/0x2bc3aa892c3a6c1e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c17 expref: 21 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582047.583033:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d8138ee00/0x2bc3aa892c3a6c1e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c17 expref: 21 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582047.583049:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8138ee00/0x2bc3aa892c3a6c1e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c17 expref: 21 pid: 5837 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582047.583062:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582047.583094:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d86673850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+20:3306:x1875464020867072:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (1651us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582047.583101:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788582047.583138:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788582047.583144:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3309:x1875464020866944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788582047.583156:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582047.583160:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d8167d800/0x2bc3aa892c3a6c2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c25 expref: 19 pid: 5838 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582047.583169:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d8167d800/0x2bc3aa892c3a6c2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c25 expref: 19 pid: 5838 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582047.583178:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8167d800/0x2bc3aa892c3a6c2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c25 expref: 19 pid: 5838 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582047.583192:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582047.583245:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:3309:x1875464020866944:12345-0@lo:103:ldlm_bl.0 Request processed in 101us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582047.583251:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788582047.583264:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788582047.583271:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:3309:x1875464020866816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788582047.583277:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582047.583282:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a6c3a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c33 expref: 17 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582047.583290:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a6c3a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c33 expref: 17 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582047.583301:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a6c3a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c33 expref: 17 pid: 5836 timeout: 416 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582047.583309:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582047.583328:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:3309:x1875464020866816:12345-0@lo:103:ldlm_bl.0 Request processed in 59us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582047.583343:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788582047.583374:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020866816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788582047.583382:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020866944:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788582047.583419:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020867072:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788582047.586490:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582047.586579:0:11171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2dbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1875464020866176:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582047.586591:0:11171:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2dad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11171:1875464020866688:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582047.586623:0:11171:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d0dbbe05e00/0x2bc3aa892c3a6c6b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582047.586728:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582047.587132:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001959936 00000100:00100000:3.0:1788582047.587140:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001959936 00010000:00010000:3.0:1788582047.587176:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0da7088200/0x2bc3aa892c3a6c10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c901b expref: 13 pid: 5838 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582047.587588:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001959808 00000100:00100000:2.0:1788582047.587593:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001959808 00010000:00010000:2.0:1788582047.587613:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d8138f000/0x2bc3aa892c3a6c4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9053 expref: 14 pid: 5836 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582047.587825:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 28 00000100:00100000:0.0:1788582047.587836:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:05a4b000-bb80-4acb-83cf-d9c3916564a8+14:2349:x1875464001959936:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788582047.587851:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582047.587857:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0da7088200/0x2bc3aa892c3a6c10 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c901b expref: 14 pid: 5838 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582047.587884:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0da7088200/0x2bc3aa892c3a6c10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c901b expref: 14 pid: 5838 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582047.587900:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0da7088200/0x2bc3aa892c3a6c10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c901b expref: 14 pid: 5838 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582047.587912:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788582047.587972:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2dd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2349:x1875464001959936:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 138us (1493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582047.587980:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 28 00000100:00100000:0.0:1788582047.588001:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 29 00000100:00100000:0.0:1788582047.588007:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:2349:x1875464001959808:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788582047.588015:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582047.588019:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d8138f000/0x2bc3aa892c3a6c4f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9053 expref: 12 pid: 5836 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582047.588028:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d8138f000/0x2bc3aa892c3a6c4f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9053 expref: 12 pid: 5836 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582047.588038:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8138f000/0x2bc3aa892c3a6c4f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9053 expref: 12 pid: 5836 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582047.588052:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d0dbbe05e00/0x2bc3aa892c3a6c6b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582047.588060:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0dbbe05e00/0x2bc3aa892c3a6c6b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582047.588083:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0dbbe05e00/0x2bc3aa892c3a6c6b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582047.588090:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0dbbe05e00/0x2bc3aa892c3a6c6b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582047.588097:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d0dbbe05e00/0x2bc3aa892c3a6c6b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582047.588104:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d0dbbe05e00/0x2bc3aa892c3a6c6b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582047.588110:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05e00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:0.0:1788582047.588114:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d0dbbe05e00/0x2bc3aa892c3a6c6b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582047.588122:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d0dbbe05e00/0x2bc3aa892c3a6c6b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582047.588138:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d0dbbe05e00/0x2bc3aa892c3a6c6b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582047.588148:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788582047.588169:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:05a4b000-bb80-4acb-83cf-d9c3916564a8+11:2349:x1875464001959808:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 162us (1442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582047.588176:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 29 00010000:00010000:2.0:1788582047.589591:0:11171:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d0dbbe05e00/0x2bc3aa892c3a6c6b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582047.589605:0:11171:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d0dbbe05e00/0x2bc3aa892c3a6c6b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582047.589611:0:11171:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0dbbe05e00/0x2bc3aa892c3a6c6b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788582047.844738:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 7a85b5d8-11d7-4e00-8094-5ec4da71e638 00000020:00000080:3.0:1788582047.844748:0:6716:0:(genops.c:885:class_export_put()) final put ffff8d0da700d800/7a85b5d8-11d7-4e00-8094-5ec4da71e638 00000020:00000080:1.0:1788582047.844813:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0da700d800/7a85b5d8-11d7-4e00-8094-5ec4da71e638 for lustre-OST0000 00000020:00000080:1.0:1788582047.844863:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d0da700f800 for lustre-OST0000 00000100:00100000:0.0:1788582048.096164:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582048.096279:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582048.096305:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582048.096348:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001960064 00000100:00100000:2.0:1788582048.096358:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001960064 00000100:00100000:2.0:1788582048.096413:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 225 00000100:00100000:2.0:1788582048.096422:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+11:2352:x1875464001960064:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788582048.096499:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+11:2352:x1875464001960064:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 78us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582048.096506:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 225 00000100:00100000:3.0:1788582048.097635:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001960192 00000100:00100000:3.0:1788582048.097646:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001960192 00000100:00100000:3.0:1788582048.097701:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001960320 00000100:00100000:3.0:1788582048.097705:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001960320 00000100:00100000:3.0:1788582048.097843:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 78 00000100:00100000:3.0:1788582048.097852:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+6:2352:x1875464001960192:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582048.097929:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+6:2352:x1875464001960192:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 78us (1774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582048.097938:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 78 00000100:00100000:3.0:1788582048.097952:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 79 00000100:00100000:3.0:1788582048.097958:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2352:x1875464001960320:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582048.097982:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7721880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2352:x1875464001960320:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 24us (1676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582048.098003:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 79 00000100:00080000:0.0:1788582048.098169:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788582048.494551:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788582048.947898:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788582048.947904:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0dbf4ee800 from 7 10000000:01000000:3.0:1788582048.947908:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788582048.947953:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27400/0x2bc3aa892c3a6c72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582048.947962:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27400/0x2bc3aa892c3a6c72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582048.947971:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27400/0x2bc3aa892c3a6c72 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582048.947990:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020867200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788582048.948048:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582048.948097:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d92363480 going to sleep for 11 seconds 00000100:00100000:1.0:1788582048.948115:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020867200 00000100:00100000:1.0:1788582048.948122:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020867200 00000100:00100000:1.0:1788582048.948257:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1788582048.948267:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:5840:x1875464020867200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788582048.948281:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582048.948295:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8167c800/0x2bc3aa892c3a6c79 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6c72 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582048.948317:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8167c800/0x2bc3aa892c3a6c79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6c72 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582048.948327:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8167c800/0x2bc3aa892c3a6c79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6c72 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582048.948336:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8167c800, rc 0) 00000100:00100000:1.0:1788582048.948385:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020867200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582048.948392:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788582048.948468:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020867200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788582048.948482:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27400/0x2bc3aa892c3a6c72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6c79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582048.948492:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27400/0x2bc3aa892c3a6c72 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6c79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582048.948542:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7720700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020867328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788582048.948568:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582048.948728:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dac24a6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788582048.948800:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020867328 00000100:00100000:3.0:1788582048.948805:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020867328 00000100:00100000:3.0:1788582048.948826:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788582048.948832:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020867328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788582048.949069:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020867328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582048.949076:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788582048.949406:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7720700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020867328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788582048.949440:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020867456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788582048.949482:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582048.949507:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8da3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788582048.949568:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020867456 00000100:00100000:3.0:1788582048.949573:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020867456 00000100:00100000:3.0:1788582048.949602:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788582048.949609:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020867456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788582048.949889:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020867456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788582048.950582:0:11228:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788582048.950640:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788582048.950657:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788582048.950665:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27400/0x2bc3aa892c3a6c72 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6c79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582048.950674:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27400/0x2bc3aa892c3a6c72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6c79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788582048.950682:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788582048.950685:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0dac39a800 from 7 10000000:01000000:1.0:1788582048.950687:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788582048.950710:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582048.950717:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582048.950726:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c80 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582048.950740:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020867584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788582048.951008:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582048.951043:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8da540 going to sleep for 11 seconds 00000100:00100000:0.0:1788582048.951094:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020867584 00000100:00100000:0.0:1788582048.951099:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020867584 00000100:00100000:0.0:1788582048.951133:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788582048.951141:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020867584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788582048.951151:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582048.951301:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0da7088200/0x2bc3aa892c3a6c87 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6c80 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582048.951325:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0da7088200/0x2bc3aa892c3a6c87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6c80 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582048.951335:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0da7088200/0x2bc3aa892c3a6c87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6c80 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582048.951343:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7088200, rc 0) 00000100:00100000:0.0:1788582048.951379:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020867584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 239us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582048.951385:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:1.0:1788582048.951476:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020867584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788582048.951488:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6c87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582048.951502:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c80 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6c87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582048.951548:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020867712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788582048.951572:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582048.951599:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8da540 going to sleep for 11 seconds 00000100:00100000:0.0:1788582048.951694:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020867712 00000100:00100000:0.0:1788582048.951698:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020867712 00000100:00100000:0.0:1788582048.951728:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788582048.951734:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020867712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788582048.953574:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020867712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1833us (1994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582048.953586:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1788582048.953809:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2ded80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020867712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788582048.953856:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020867840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788582048.953902:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582048.953940:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c8364bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788582048.954055:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020867840 00000100:00100000:0.0:1788582048.954061:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020867840 00000100:00100000:0.0:1788582048.954101:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788582048.954109:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020867840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788582048.954293:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020867840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582048.954300:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1788582048.954377:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2dad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020867840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788582048.955265:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020867456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 5652us (5777us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582048.955283:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000040:00080000:2.0:1788582048.955291:0:11229:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788582048.955696:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788582048.955721:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788582048.955729:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c80 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6c87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582048.955747:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6c87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788582048.955758:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788582048.955761:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0d945e5800 from 7 10000000:01000000:0.0:1788582048.955763:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788582048.955802:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7088400/0x2bc3aa892c3a6c8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582048.955811:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0da7088400/0x2bc3aa892c3a6c8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582048.955829:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0da7088400/0x2bc3aa892c3a6c8e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582048.955848:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7720700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020867968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788582048.955889:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582048.955922:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dac24aa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788582048.957753:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020867968 00000100:00100000:2.0:1788582048.957766:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020867968 00000100:00100000:2.0:1788582048.957867:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1788582048.957877:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020867968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788582048.957892:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582048.957906:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0dbbe05400/0x2bc3aa892c3a6c95 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6c8e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582048.957927:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0dbbe05400/0x2bc3aa892c3a6c95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6c8e expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582048.957935:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0dbbe05400/0x2bc3aa892c3a6c95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6c8e expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582048.957952:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05400, rc 0) 00000100:00100000:2.0:1788582048.958013:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020867968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (2123us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582048.958019:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788582048.958050:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7720700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020867968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788582048.958066:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0da7088400/0x2bc3aa892c3a6c8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6c95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582048.958075:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0da7088400/0x2bc3aa892c3a6c8e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6c95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582048.958137:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020868096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788582048.958177:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582048.968250:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020868096 00000100:00100000:0.0:1788582048.968266:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020868096 00000100:00100000:0.0:1788582048.968331:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788582048.968341:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020868096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788582048.968621:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020868096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 280us (10442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582048.968629:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788582048.969249:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d92363480 going to sleep for 11 seconds 00000100:00100000:3.0:1788582048.969276:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020868096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788582048.969329:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020868224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788582048.969386:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582048.969420:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d92363480 going to sleep for 11 seconds 00000100:00100000:0.0:1788582048.969617:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020868224 00000100:00100000:0.0:1788582048.969622:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020868224 00000100:00100000:0.0:1788582048.969662:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788582048.969670:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020868224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788582048.969857:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020868224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582048.969865:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788582048.969902:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020868224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788582048.970884:0:11230:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1788582048.971085:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1788582048.971101:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788582048.971111:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7088400/0x2bc3aa892c3a6c8e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6c95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582048.971122:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0da7088400/0x2bc3aa892c3a6c8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6c95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582049.248981:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582049.249022:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001960448 00000100:00100000:1.0:1788582049.249032:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001960448 00000100:00100000:1.0:1788582049.249080:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 235 00000100:00100000:1.0:1788582049.249089:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+11:5589:x1875464001960448:12345-192.168.201.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788582049.249105:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582049.249124:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8167d800/0x2bc3aa892c3a6c9c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c907d expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582049.249154:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8167d800/0x2bc3aa892c3a6c9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c907d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582049.249165:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8167d800/0x2bc3aa892c3a6c9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c907d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582049.249174:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8167d800, rc 0) 00000100:00100000:1.0:1788582049.249248:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:5589:x1875464001960448:12345-192.168.201.12@tcp:101:ll_cfg_requeue.0 Request processed in 159us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582049.249256:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 235 00000100:00100000:3.0:1788582049.256274:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582049.256314:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001960576 00000100:00100000:3.0:1788582049.256324:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001960576 00000100:00100000:3.0:1788582049.256379:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 236 00000100:00100000:3.0:1788582049.256389:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:5589:x1875464001960576:12345-192.168.201.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788582049.256671:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:5589:x1875464001960576:12345-192.168.201.12@tcp:501:ll_cfg_requeue.0 Request processed in 281us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582049.256689:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 236 00000100:00100000:1.0:1788582049.273987:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582049.274130:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001960704 00000100:00100000:2.0:1788582049.274140:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001960704 00000100:00100000:2.0:1788582049.274195:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 237 00000100:00100000:2.0:1788582049.274227:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:5589:x1875464001960704:12345-192.168.201.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788582049.274437:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:5589:x1875464001960704:12345-192.168.201.12@tcp:503:ll_cfg_requeue.0 Request processed in 212us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582049.274446:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 237 00000100:00100000:2.0:1788582049.294014:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582049.298994:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001960832 00000100:00100000:0.0:1788582049.299009:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001960832 00000100:00100000:0.0:1788582049.299067:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 238 00000100:00100000:0.0:1788582049.299077:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:5589:x1875464001960832:12345-192.168.201.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788582049.299094:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582049.299111:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a6ca3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9084 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582049.299151:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a6ca3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9084 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582049.299162:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a6ca3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9084 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582049.299171:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7088600, rc 0) 00000100:00100000:0.0:1788582049.299252:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:5589:x1875464001960832:12345-192.168.201.12@tcp:101:ll_cfg_requeue.0 Request processed in 176us (5248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582049.299260:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 238 00000100:00100000:0.0:1788582049.303007:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582049.303140:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001960960 00000100:00100000:1.0:1788582049.303150:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001960960 00000100:00100000:1.0:1788582049.303218:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 239 00000100:00100000:1.0:1788582049.303228:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:5589:x1875464001960960:12345-192.168.201.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788582049.303497:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:5589:x1875464001960960:12345-192.168.201.12@tcp:501:ll_cfg_requeue.0 Request processed in 269us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582049.303505:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 239 00000100:00100000:0.0:1788582049.305436:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582049.305470:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001961088 00000100:00100000:0.0:1788582049.305480:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001961088 00000100:00100000:0.0:1788582049.305535:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 240 00000100:00100000:0.0:1788582049.305544:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:5589:x1875464001961088:12345-192.168.201.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788582049.305737:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:5589:x1875464001961088:12345-192.168.201.12@tcp:503:ll_cfg_requeue.0 Request processed in 193us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582049.305755:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 240 00010000:00010000:3.0:1788582049.525465:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582050.285584:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788582050.285608:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0db7723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020868352:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788582050.285679:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582050.285748:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020868352 00000100:00100000:0.0:1788582050.285767:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020868352 00000100:00100000:0.0:1788582050.285826:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788582050.285836:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7720700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020868352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788582050.285871:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582050.285916:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7720700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020868352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582050.285923:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788582050.285944:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788582050.285991:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0db7723100 x1875464020868352/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788582050.286010:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0db7723100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020868352:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788582050.293800:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020868480:0@lo:400:kworker.0 00000100:00100000:1.0:1788582050.293813:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875464020868608:0@lo:400:kworker.0 00000100:00100000:2.0:1788582050.294729:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582050.294794:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab901c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020868992:0@lo:400:kworker.0 00000100:00100000:2.0:1788582050.294829:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582050.294871:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020868480 00000100:00100000:2.0:1788582050.294878:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020868480 00000100:00100000:2.0:1788582050.294925:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788582050.294933:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020868480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582050.294981:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f89450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020868480:12345-0@lo:400:kworker.0 Request processed in 47us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582050.294987:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1788582050.295031:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020868992 00000100:00100000:2.0:1788582050.295041:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020868992 00000100:00100000:2.0:1788582050.295075:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788582050.295082:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020868992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582050.295114:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020868992:12345-0@lo:400:kworker.0 Request processed in 33us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582050.295120:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1788582050.295138:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788582050.295152:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020868864:0@lo:400:kworker.0 00000100:00100000:2.0:1788582050.295183:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582050.295219:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788582050.295225:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab903100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875464020868736:0@lo:400:kworker.0 00000100:00100000:2.0:1788582050.295245:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582050.295271:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020868864 00000100:00100000:2.0:1788582050.295275:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020868864 00000100:00100000:2.0:1788582050.295305:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788582050.295311:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dba93f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020868864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582050.295342:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dba93f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020868864:12345-0@lo:400:kworker.0 Request processed in 31us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582050.295348:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788582050.295506:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020868736 00000100:00100000:2.0:1788582050.295510:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020868736 00000100:00100000:2.0:1788582050.295542:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788582050.295549:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875464020868736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582050.295578:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875464020868736:12345-0@lo:400:kworker.0 Request processed in 29us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582050.295586:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:2.0:1788582050.295604:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788582050.295613:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788582050.295639:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab903100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875464020868736:0@lo:400:kworker.0 00010000:00080000:2.0:1788582050.295652:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dab901500 x1875464020868864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582050.295662:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab901500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020868864:0@lo:400:kworker.0 00000100:00100000:2.0:1788582050.295693:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab901c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020868992:0@lo:400:kworker.0 00000100:00100000:2.0:1788582050.295703:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2df100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020868480:0@lo:400:kworker.0 00000100:00100000:1.0:1788582050.299679:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582050.299740:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020868608 00000100:00100000:1.0:1788582050.299749:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020868608 00000100:00100000:1.0:1788582050.299814:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788582050.299826:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875464020868608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582050.299892:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab900000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875464020868608:12345-0@lo:400:kworker.0 Request processed in 68us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582050.299900:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788582050.299951:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875464020868608:0@lo:400:kworker.0 00010000:00010000:3.0:1788582050.541491:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788582051.136980:0:11370:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg112-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788582051.567487:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582051.823376:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788582051.823401:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020869120:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788582051.823471:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582051.823617:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020869120 00000100:00100000:1.0:1788582051.823626:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020869120 00000100:00100000:1.0:1788582051.823700:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788582051.823710:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7723100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020869120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788582051.823754:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788582051.823801:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7723100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020869120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (330us total) trans 0 rc 0/0 00010000:00080000:2.0:1788582051.824040:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dab902680 x1875464020869120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582067 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582051.824058:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab902680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020869120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788582051.824130:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00010000:0.0:1788582052.590648:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582053.213386:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582053.213436:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582053.213475:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582053.213573:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001961344 00000100:00100000:2.0:1788582053.213595:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001961344 00000100:00100000:2.0:1788582053.213677:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001961472 00000100:00100000:2.0:1788582053.213681:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001961472 00000100:00100000:2.0:1788582053.213740:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 83 00000100:00100000:2.0:1788582053.213752:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+6:2349:x1875464001961344:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788582053.213836:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab902680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+6:2349:x1875464001961344:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 85us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582053.213843:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 83 00000100:00100000:2.0:1788582053.213861:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 84 00000100:00100000:2.0:1788582053.213868:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2349:x1875464001961472:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788582053.213893:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab901c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2349:x1875464001961472:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 26us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582053.213907:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001961216 00000100:00100000:0.0:1788582053.213914:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001961216 00000100:00100000:2.0:1788582053.213920:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 84 00000100:00100000:0.0:1788582053.213957:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 242 00000100:00100000:0.0:1788582053.213966:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2349:x1875464001961216:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582053.214004:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2349:x1875464001961216:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 39us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582053.214019:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 242 00000100:00080000:1.0:1788582053.215530:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788582053.614606:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788582054.244992:0:11470:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 00:20:52 (1788582052) === 00000100:00100000:2.0:1788582054.471845:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582054.471944:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582054.474407:0:5852:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001961728 00000100:00100000:0.0:1788582054.474424:0:5852:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001961728 00000100:00100000:0.0:1788582054.474501:0:5852:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 0 00000100:00100000:0.0:1788582054.474511:0:5852:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b99087a3-3c83-4416-b2b9-d522b9885111+6:9665:x1875464001961728:12345-192.168.201.12@tcp:700:mkdir.0 00000100:00100000:0.0:1788582054.474621:0:5852:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b99087a3-3c83-4416-b2b9-d522b9885111+6:9665:x1875464001961728:12345-192.168.201.12@tcp:700:mkdir.0 Request processed in 110us (2675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582054.474628:0:5852:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 0 00000100:00100000:1.0:1788582054.476189:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001961600 00000100:00100000:1.0:1788582054.476199:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001961600 00000100:00100000:2.0:1788582054.476383:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 14 00000100:00100000:2.0:1788582054.476393:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+6:2352:x1875464001961600:12345-192.168.201.12@tcp:41:mkdir.0 00000004:00000024:2.0:1788582054.476434:0:10136:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788582054.476523:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+6:2352:x1875464001961600:12345-192.168.201.12@tcp:41:mkdir.0 Request processed in 131us (4690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582054.476530:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 14 00000100:00100000:0.0:1788582054.477461:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582054.478224:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001961984 00000100:00100000:1.0:1788582054.478233:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001961984 00000100:00100000:1.0:1788582054.478281:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 15 00000100:00100000:1.0:1788582054.478290:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+6:9665:x1875464001961984:12345-192.168.201.12@tcp:36:mkdir.0 00010000:00010000:1.0:1788582054.478341:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582054.478413:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089a00/0x2bc3aa892c3a6b8b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9006 expref: 6 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.478433:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d888de100) 00010000:00010000:1.0:1788582054.478444:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788582054.478849:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6caa lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.478862:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6caa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.478872:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6caa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.478899:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6cb1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.478916:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6cb1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.478924:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6cb1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582054.481442:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788582054.481459:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6caa lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.481470:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6caa lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.481478:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6caa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.481483:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8167d600 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582054.481489:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6caa lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.481496:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6caa lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.481511:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0da2fafb00) 00010000:00010000:1.0:1788582054.481514:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582054.481519:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6caa lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.481525:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6caa lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788582054.481558:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000007483ce2 reply state 00000000bcdab327 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6cb1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582054.481567:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788582054.481690:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+7:9665:x1875464001961984:12345-192.168.201.12@tcp:36:mkdir.0 Request processed in 3389us (4220us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788582054.481701:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 15 00010000:00010000:2.0:1788582054.483677:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6cb1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.483702:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6cb1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.483709:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6cb1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.483715:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8167da00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582054.483719:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6cb1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.483726:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6cb1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.483807:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d0da2faf700) 00010000:00010000:2.0:1788582054.483810:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582054.483815:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6cb1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.483836:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6cb1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582054.491940:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582054.492572:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001962112 00000100:00100000:3.0:1788582054.492711:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001962112 00000100:00100000:3.0:1788582054.492870:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 16 00000100:00100000:3.0:1788582054.492880:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+6:9666:x1875464001962112:12345-192.168.201.12@tcp:101:chmod.0 00010000:00010000:3.0:1788582054.492902:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582054.492928:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6cb8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c908b expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.493004:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a6cbf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.493019:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a6cbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.493032:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a6cbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582054.493066:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788582054.493070:0:10137:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788582054.493103:0:10137:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a6cbf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.493141:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6cb8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c908b expref: 8 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.493178:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a6cbf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c908b expref: 7 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.493187:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:3.0:1788582054.493190:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788582054.493194:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27200, rc 0) 00000100:00100000:3.0:1788582054.493292:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7721f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+7:9666:x1875464001962112:12345-192.168.201.12@tcp:101:chmod.0 Request processed in 407us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582054.493954:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 16 00000100:00100000:0.0:1788582054.498977:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582054.499106:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001962368 00000100:00100000:1.0:1788582054.499116:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001962368 00000100:00100000:1.0:1788582054.499180:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 17 00000100:00100000:1.0:1788582054.499192:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+7:9666:x1875464001962368:12345-192.168.201.12@tcp:36:chmod.0 00010000:00010000:1.0:1788582054.499281:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582054.499317:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a6cbf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c908b expref: 7 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.499335:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:1.0:1788582054.499346:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788582054.499371:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6cc6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.499384:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6cc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.499394:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6cc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788582054.499715:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000478c14e0 reply state 00000000d97748fe transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6cc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582054.499744:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788582054.499752:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788582054.499825:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7720a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+8:9666:x1875464001962368:12345-192.168.201.12@tcp:36:chmod.0 Request processed in 635us (858us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788582054.499832:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 17 00010000:00010000:1.0:1788582054.504612:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6cc6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.504631:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6cc6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.504639:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6cc6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.504645:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8167d600 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582054.504649:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6cc6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.504657:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6cc6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.504674:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0da2fafb00) 00010000:00010000:1.0:1788582054.504678:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788582054.504693:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6cc6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.504700:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6cc6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582054.518978:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582054.519375:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001962496 00000100:00100000:3.0:1788582054.519384:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001962496 00000100:00100000:0.0:1788582054.519604:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 18 00000100:00100000:0.0:1788582054.519613:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+7:9667:x1875464001962496:12345-192.168.201.12@tcp:101:chown.0 00010000:00010000:0.0:1788582054.519634:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582054.519653:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a6ccd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9092 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.519807:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6cd4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.519821:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.519831:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582054.519874:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788582054.519876:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788582054.519906:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6cd4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.519924:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a6ccd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9092 expref: 9 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.519936:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6cd4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9092 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.519942:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d888def00) 00010000:00010000:0.0:1788582054.519944:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788582054.519946:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7089000, rc 0) 00000100:00100000:0.0:1788582054.520007:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+8:9667:x1875464001962496:12345-192.168.201.12@tcp:101:chown.0 Request processed in 395us (1040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582054.520012:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 18 00000100:00100000:0.0:1788582054.521931:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582054.521977:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001962624 00000100:00100000:3.0:1788582054.521988:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001962624 00000100:00100000:3.0:1788582054.522042:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 19 00000100:00100000:3.0:1788582054.522052:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+8:9667:x1875464001962624:12345-192.168.201.12@tcp:101:chown.0 00010000:00010000:3.0:1788582054.522072:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582054.522088:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6cdb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9099 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522135:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6ce2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522145:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6ce2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522152:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6ce2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522176:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6ce9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522180:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522184:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522405:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a6cf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522410:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a6cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522415:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a6cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582054.522445:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788582054.522449:0:10137:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788582054.522523:0:10137:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a6cf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522532:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6ce2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522536:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6ce2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522541:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6ce2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522551:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582054.522554:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6ce2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522559:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6ce2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522567:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d888def00) 00010000:00010000:3.0:1788582054.522569:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582054.522572:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6ce2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522576:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6ce2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522584:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6ce9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522587:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6ce9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522590:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6ce9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522593:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582054.522595:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6ce9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522598:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6ce9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522608:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d0d917bde00) 00010000:00010000:3.0:1788582054.522610:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582054.522612:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6ce9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522615:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6ce9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522636:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6cdb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9099 expref: 10 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522644:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a6cf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9099 expref: 9 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.522648:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d0d917bd400) 00010000:00010000:3.0:1788582054.522649:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788582054.522650:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27a00, rc 0) 00000100:00100000:3.0:1788582054.522732:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+9:9667:x1875464001962624:12345-192.168.201.12@tcp:101:chown.0 Request processed in 681us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582054.522738:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 19 00000100:00100000:1.0:1788582054.525098:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582054.525384:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001962880 00000100:00100000:2.0:1788582054.525393:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001962880 00000100:00100000:2.0:1788582054.525607:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 20 00000100:00100000:2.0:1788582054.525619:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+9:9667:x1875464001962880:12345-192.168.201.12@tcp:36:chown.0 00010000:00010000:2.0:1788582054.525701:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582054.525740:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a6cf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9099 expref: 9 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.525758:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d0d917bd400) 00010000:00010000:2.0:1788582054.525772:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788582054.525806:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04000/0x2bc3aa892c3a6cf7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.525820:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04000/0x2bc3aa892c3a6cf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.525830:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04000/0x2bc3aa892c3a6cf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788582054.544588:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a27c1a81 reply state 00000000c316d598 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04000/0x2bc3aa892c3a6cf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582054.544608:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788582054.544623:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000001:00080000:3.0:1788582054.544740:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1788582054.544751:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab901500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+9:9667:x1875464001962880:12345-192.168.201.12@tcp:36:chown.0 Request processed in 19130us (19658us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788582054.544760:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 20 00000001:00080000:3.0:1788582054.544832:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:2.0:1788582054.544886:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04000/0x2bc3aa892c3a6cf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.544896:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04000/0x2bc3aa892c3a6cf7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.544904:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04000/0x2bc3aa892c3a6cf7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.544921:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582054.544926:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04000/0x2bc3aa892c3a6cf7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.544933:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04000/0x2bc3aa892c3a6cf7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.544950:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d0d85afcb00) 00010000:00010000:2.0:1788582054.544954:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788582054.544958:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04000/0x2bc3aa892c3a6cf7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.544964:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04000/0x2bc3aa892c3a6cf7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582054.566714:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582054.567256:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001963008 00000100:00100000:0.0:1788582054.567278:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001963008 00000100:00100000:0.0:1788582054.567342:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 21 00000100:00100000:0.0:1788582054.567353:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:9668:x1875464001963008:12345-192.168.201.12@tcp:101:touch.500 00010000:00010000:0.0:1788582054.567380:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582054.567401:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6cfe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c90a0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788582054.572256:0:5843:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4679us 00010000:00010000:0.0:1788582054.592899:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6d05 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.593717:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6d05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.593730:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6d05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.593752:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6d0c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.593758:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6d0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.593765:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6d0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.594108:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088c00/0x2bc3aa892c3a6d13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.594118:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088c00/0x2bc3aa892c3a6d13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.594126:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088c00/0x2bc3aa892c3a6d13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582054.594150:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788582054.594154:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788582054.594190:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088c00/0x2bc3aa892c3a6d13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.594230:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6d05 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.594245:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6d05 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.594252:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6d05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.594258:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582054.594262:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6d05 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.594270:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6d05 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.594282:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d888def00) 00010000:00010000:0.0:1788582054.594285:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582054.594290:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6d05 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.594296:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6d05 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.594307:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6d0c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.594312:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6d0c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.594318:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6d0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.594323:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582054.594332:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6d0c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.594338:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6d0c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.594346:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d0d888deb00) 00010000:00010000:0.0:1788582054.594349:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582054.594352:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6d0c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.594357:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6d0c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.594395:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6cfe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90a0 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.594409:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088c00/0x2bc3aa892c3a6d13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90a0 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.595025:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d0d888dee00) 00010000:00010000:0.0:1788582054.595028:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788582054.595031:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7088c00, rc 0) 00000100:00100000:0.0:1788582054.595139:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab903100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+7:9668:x1875464001963008:12345-192.168.201.12@tcp:101:touch.500 Request processed in 27786us (28433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582054.595148:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 21 00000100:00100000:0.0:1788582054.598641:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582054.598716:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001963264 00000100:00100000:3.0:1788582054.598725:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001963264 00000100:00100000:3.0:1788582054.598784:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 22 00000100:00100000:3.0:1788582054.598795:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+7:9668:x1875464001963264:12345-192.168.201.12@tcp:101:touch.500 00010000:00010000:3.0:1788582054.598817:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582054.598849:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6d1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c90a7 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.599121:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6d21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.599136:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6d21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.599147:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6d21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.599163:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6d28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.599170:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.599177:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788582054.600789:0:10137:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788582054.601671:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a6d2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.601700:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a6d2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.601714:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a6d2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.601758:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6d21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.601778:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6d21 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.601784:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6d21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.601790:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582054.601794:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6d21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.601802:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6d21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.601815:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d0d888dee00) 00010000:00010000:3.0:1788582054.601818:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582054.601823:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6d21 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.601829:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6d21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788582054.601842:0:10137:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000eb0be05e reply state 00000000f81f8f3d transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582054.601851:0:10137:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788582054.601891:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6d1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90a7 expref: 10 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.601906:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a6d2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90a7 expref: 9 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.601925:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d0d917bdb00) 00010000:00010000:3.0:1788582054.601927:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788582054.601931:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26000, rc 0) 00000100:00100000:3.0:1788582054.602064:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+10:9668:x1875464001963264:12345-192.168.201.12@tcp:101:touch.500 Request processed in 3270us (3431us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788582054.602140:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 22 00010000:00010000:2.0:1788582054.604727:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6d28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.604745:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6d28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.604751:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6d28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.604756:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582054.604761:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6d28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.604768:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6d28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.604801:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b3b195e (ffff8d0d917bde00) 00010000:00010000:2.0:1788582054.604805:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582054.604809:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6d28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.604816:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6d28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582054.607095:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582054.607372:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001963520 00000100:00100000:1.0:1788582054.607383:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001963520 00000100:00100000:1.0:1788582054.607453:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 23 00000100:00100000:1.0:1788582054.607464:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+9:9668:x1875464001963520:12345-192.168.201.12@tcp:36:touch.500 00010000:00010000:1.0:1788582054.607518:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582054.607543:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a6d2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90a7 expref: 9 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.607561:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d0d917bdb00) 00010000:00010000:1.0:1788582054.607571:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788582054.607617:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6d3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.607629:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.607639:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788582054.607816:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000556ff660 reply state 000000006bcb8933 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582054.607848:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788582054.607981:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+10:9668:x1875464001963520:12345-192.168.201.12@tcp:36:touch.500 Request processed in 518us (895us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788582054.607989:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 23 00010000:00010000:1.0:1788582054.610704:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.610724:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6d3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.610732:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6d3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.610739:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8167da00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582054.610743:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6d3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.610750:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6d3d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.610767:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d0da2faf700) 00010000:00010000:1.0:1788582054.610770:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582054.610775:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6d3d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.610780:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6d3d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582054.612135:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582054.612240:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001963648 00000100:00100000:2.0:1788582054.612250:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001963648 00000100:00100000:2.0:1788582054.612310:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 24 00000100:00100000:2.0:1788582054.612320:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+9:9668:x1875464001963648:12345-192.168.201.12@tcp:101:touch.500 00010000:00010000:2.0:1788582054.612345:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582054.612367:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04000/0x2bc3aa892c3a6d44 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c90ae expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.612446:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04000/0x2bc3aa892c3a6d44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90ae expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.612460:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04000/0x2bc3aa892c3a6d44 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90ae expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.612478:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d0d85afcb00) 00010000:00010000:2.0:1788582054.612482:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788582054.612485:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04000, rc 0) 00000100:00100000:2.0:1788582054.612544:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+10:9668:x1875464001963648:12345-192.168.201.12@tcp:101:touch.500 Request processed in 224us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582054.612565:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 24 00000100:00100000:0.0:1788582054.615628:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582054.615754:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001963776 00000100:00100000:3.0:1788582054.615764:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001963776 00000100:00100000:3.0:1788582054.615858:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 16 00000100:00100000:3.0:1788582054.615867:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875464001963776:12345-192.168.201.12@tcp:8:touch.500 00010000:00080000:3.0:1788582054.615900:0:6692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp t0 exp 0000000000000000 cur 273 last 0 00000020:00000080:3.0:1788582054.615934:0:6692:0:(genops.c:1385:class_connect()) connect: client b99087a3-3c83-4416-b2b9-d522b9885111, cookie 0x2bc3aa892c3a6d4b 00002000:00100000:3.0:1788582054.615946:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b99087a3-3c83-4416-b2b9-d522b9885111/ffff8d0da700e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788582054.615969:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788582054.616191:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788582054.616253:0:6692:0:(import.c:65:import_set_state_nolock()) ffff8d0da7009000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788582054.616316:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+6:2348:x1875464001963776:12345-192.168.201.12@tcp:8:touch.500 Request processed in 447us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582054.616324:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 16 00000100:00100000:0.0:1788582054.618280:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582054.618422:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001963904 00000100:00100000:2.0:1788582054.618430:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001963904 00000100:00080000:1.0:1788582054.618522:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788582054.618606:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 17 00000100:00100000:2.0:1788582054.618617:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+6:0:x1875464001963904:12345-192.168.201.12@tcp:2:touch.500 00010000:00010000:3.0:1788582054.642898:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788582054.648061:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1788582054.648092:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b99087a3-3c83-4416-b2b9-d522b9885111 00000100:00100000:3.0:1788582054.648279:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+5:0:x1875464001963904:12345-192.168.201.12@tcp:2:touch.500 Request processed in 29657us (29999us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788582054.648290:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 17 00000100:00100000:0.0:1788582054.651706:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582054.651798:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001964160 00000100:00100000:3.0:1788582054.651815:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001964160 00000100:00100000:3.0:1788582054.651876:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 2 00000100:00100000:3.0:1788582054.651888:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+10:9668:x1875464001964160:12345-192.168.201.12@tcp:35:touch.500 00000100:00100000:3.0:1788582054.652283:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+11:9668:x1875464001964160:12345-192.168.201.12@tcp:35:touch.500 Request processed in 396us (585us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788582054.652291:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 2 00000100:00100000:3.0:1788582054.662562:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582054.662880:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001964288 00000100:00100000:2.0:1788582054.662892:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001964288 00000100:00100000:2.0:1788582054.663000:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 25 00000100:00100000:2.0:1788582054.663011:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+11:9669:x1875464001964288:12345-192.168.201.12@tcp:101:rm.0 00010000:00010000:2.0:1788582054.663034:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582054.663057:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a6d52 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c90b5 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.663132:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04c00/0x2bc3aa892c3a6d59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.663146:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04c00/0x2bc3aa892c3a6d59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.663157:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04c00/0x2bc3aa892c3a6d59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582054.663192:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788582054.663195:0:10137:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788582054.663258:0:10137:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04c00/0x2bc3aa892c3a6d59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.663304:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a6d52 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90b5 expref: 13 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.663323:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04c00/0x2bc3aa892c3a6d59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90b5 expref: 12 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.663330:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d0d888dee00) 00010000:00010000:2.0:1788582054.663333:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788582054.663336:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04c00, rc 0) 00000100:00100000:2.0:1788582054.663405:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+12:9669:x1875464001964288:12345-192.168.201.12@tcp:101:rm.0 Request processed in 395us (852us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582054.663519:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 25 00000100:00100000:0.0:1788582054.669002:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582054.669093:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001964544 00000100:00100000:2.0:1788582054.669104:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001964544 00000100:00100000:2.0:1788582054.669166:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 26 00000100:00100000:2.0:1788582054.669176:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+12:9669:x1875464001964544:12345-192.168.201.12@tcp:101:rm.0 00010000:00010000:2.0:1788582054.669199:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582054.669262:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a6d60 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c90bc expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582054.669360:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788582054.669492:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a6d60 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90bc expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.669506:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d888def00) 00010000:00010000:2.0:1788582054.669510:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788582054.669528:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a6d60 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90bc expref: 14 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.669541:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05800, rc 0) 00000100:00100000:2.0:1788582054.669603:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+13:9669:x1875464001964544:12345-192.168.201.12@tcp:101:rm.0 Request processed in 428us (613us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788582054.669610:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 26 00000100:00100000:0.0:1788582054.674020:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582054.674168:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001964672 00000100:00100000:3.0:1788582054.674190:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001964672 00000100:00100000:3.0:1788582054.674273:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 3 00000100:00100000:3.0:1788582054.674284:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+13:9669:x1875464001964672:12345-192.168.201.12@tcp:37:rm.0 00000100:00100000:1.0:1788582054.679690:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+13:9669:x1875464001964672:12345-192.168.201.12@tcp:37:rm.0 Request processed in 5373us (5646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582054.679715:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 3 00000100:00100000:0.0:1788582054.683123:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582054.683267:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001964928 00000100:00100000:1.0:1788582054.683277:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001964928 00000100:00100000:1.0:1788582054.683356:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 4 00000100:00100000:1.0:1788582054.683365:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d84f80450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+13:9669:x1875464001964928:12345-192.168.201.12@tcp:35:rm.0 00000100:00100000:1.0:1788582054.683760:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d84f80450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+14:9669:x1875464001964928:12345-192.168.201.12@tcp:35:rm.0 Request processed in 395us (736us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788582054.683768:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 4 00000100:00100000:0.0:1788582054.686577:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582054.686648:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001965184 00000100:00100000:3.0:1788582054.686667:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001965184 00000100:00100000:3.0:1788582054.686737:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 27 00000100:00100000:3.0:1788582054.686748:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+14:9669:x1875464001965184:12345-192.168.201.12@tcp:101:rm.0 00010000:00010000:3.0:1788582054.686772:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582054.686794:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6d6e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c90c3 expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.686891:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6d75 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.686906:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6d75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.686918:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6d75 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582054.686948:0:10136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788582054.687133:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6d6e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90c3 expref: 17 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.687153:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6d75 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90c3 expref: 16 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582054.687161:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d0d888dee00) 00010000:00010000:3.0:1788582054.687164:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788582054.687168:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26800, rc 0) 00000100:00100000:2.0:1788582054.691132:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+16:9669:x1875464001965184:12345-192.168.201.12@tcp:101:rm.0 Request processed in 4374us (4552us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788582054.691146:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 27 00000100:00100000:0.0:1788582054.698005:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582054.698115:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001965312 00000100:00100000:2.0:1788582054.698126:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001965312 00000100:00100000:2.0:1788582054.698193:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 28 00000100:00100000:2.0:1788582054.698244:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+16:9669:x1875464001965312:12345-192.168.201.12@tcp:41:rm.0 00000004:00000024:2.0:1788582054.698306:0:10137:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1788582054.698371:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+16:9669:x1875464001965312:12345-192.168.201.12@tcp:41:rm.0 Request processed in 167us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582054.698379:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 28 00000100:00100000:3.0:1788582054.705331:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582054.705427:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001965440 00000100:00100000:0.0:1788582054.705437:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001965440 00000100:00100000:0.0:1788582054.705491:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 29 00000100:00100000:0.0:1788582054.705502:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+16:9669:x1875464001965440:12345-192.168.201.12@tcp:101:rm.0 00010000:00010000:0.0:1788582054.705522:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582054.705540:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6d83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c90ca expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705600:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6d8a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705614:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6d8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705624:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6d8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705637:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6d91 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705644:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6d91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705650:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6d91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705767:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a6d98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705775:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a6d98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705782:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a6d98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582054.705806:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788582054.705810:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788582054.705829:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a6d98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705839:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a6d98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705847:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6d8a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705853:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6d8a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705859:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6d8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705865:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582054.705869:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6d8a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705877:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6d8a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705894:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d0d888dee00) 00010000:00010000:0.0:1788582054.705897:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582054.705901:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6d8a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705908:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6d8a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705920:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6d91 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705925:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6d91 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705931:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6d91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705937:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582054.705940:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6d91 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705946:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6d91 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705951:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b3b195e (ffff8d0d888dec00) 00010000:00010000:0.0:1788582054.705953:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582054.705956:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6d91 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705961:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6d91 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.705996:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6d83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90ca expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.706009:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a6d98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90ca expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.706016:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d0d85afcb00) 00010000:00010000:0.0:1788582054.706019:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788582054.706021:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7088a00, rc 0) 00000100:00100000:0.0:1788582054.706089:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+17:9669:x1875464001965440:12345-192.168.201.12@tcp:101:rm.0 Request processed in 588us (765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582054.706095:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 29 00000100:00100000:0.0:1788582054.708999:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582054.709088:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001965696 00000100:00100000:1.0:1788582054.709098:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001965696 00000100:00100000:1.0:1788582054.709157:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 30 00000100:00100000:1.0:1788582054.709167:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+17:9669:x1875464001965696:12345-192.168.201.12@tcp:36:rm.0 00010000:00010000:1.0:1788582054.709255:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788582054.709284:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a6d98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90ca expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.709304:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04000/0x2bc3aa892c3a6d44 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90ae expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.709314:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d0d85afcb00) 00010000:00010000:1.0:1788582054.709329:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04c00/0x2bc3aa892c3a6d59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90b5 expref: 15 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.709336:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d0d888dee00) 00010000:00010000:1.0:1788582054.709339:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788582054.709372:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6d9f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.709384:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6d9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.709393:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6d9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.709406:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6da6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.709424:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6da6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.709432:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6da6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.709574:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6dad lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.709583:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6dad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.709590:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6dad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788582054.710336:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:1.0:1788582054.710348:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 273704145240ns, next at 274704142457ns, rc = 0 00010000:00010000:1.0:1788582054.710409:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a6db4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.710418:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a6db4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.710432:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a6db4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.710440:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a6db4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.710446:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a6db4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.710453:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a6db4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.710472:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788582054.710491:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6dad lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.710498:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6dad lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.710504:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6dad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.710510:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582054.710514:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6dad lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.710521:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6dad lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.710530:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d0da2faf700) 00010000:00010000:1.0:1788582054.710533:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788582054.710542:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6dad lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.710548:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6dad lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.710563:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6d9f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.710570:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6d9f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.710575:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6d9f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.710580:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8167da00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582054.710583:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6d9f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.710589:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6d9f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.710595:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d0d888dee00) 00010000:00010000:1.0:1788582054.710597:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582054.710600:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6d9f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.710604:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167da00/0x2bc3aa892c3a6d9f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788582054.710612:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000218a5a73 reply state 0000000012050da5 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6da6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582054.710631:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788582054.710717:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+16:9669:x1875464001965696:12345-192.168.201.12@tcp:36:rm.0 Request processed in 1550us (1727us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788582054.710725:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 30 00010000:00010000:0.0:1788582054.711339:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788582054.711346:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a6db4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.711353:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd200 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:0.0:1788582054.711356:0:7637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a6db4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.711362:0:7637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a6db4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.711372:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff8d0da2faf700) 00010000:00010000:0.0:1788582054.711374:0:7637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788582054.711377:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a6db4 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.711394:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a6db4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582054.711420:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582054.711422:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582054.711424:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788582054.714429:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00010000:00010000:2.0:1788582054.714572:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6da6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.714586:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6da6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.714594:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6da6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.714600:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8167d600 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582054.714621:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6da6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.714629:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6da6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.714647:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x1b3b195e (ffff8d0da2fafb00) 00010000:00010000:2.0:1788582054.714650:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582054.714655:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6da6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582054.714674:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8167d600/0x2bc3aa892c3a6da6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x1b3b195e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582054.714814:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001965952 00000100:00100000:1.0:1788582054.714827:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001965952 00000100:00100000:1.0:1788582054.714895:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 5 00000100:00100000:1.0:1788582054.714906:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+15:9669:x1875464001965952:12345-192.168.201.12@tcp:35:rm.0 00000100:00100000:1.0:1788582054.715188:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+16:9669:x1875464001965952:12345-192.168.201.12@tcp:35:rm.0 Request processed in 283us (778us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788582054.715195:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 5 00000100:00100000:3.0:1788582054.718276:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582054.718524:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001966208 00000100:00100000:1.0:1788582054.718535:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001966208 00000100:00100000:1.0:1788582054.718594:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 31 00000100:00100000:1.0:1788582054.718605:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+16:9669:x1875464001966208:12345-192.168.201.12@tcp:36:rm.0 00010000:00010000:1.0:1788582054.718672:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788582054.718708:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6d75 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90c3 expref: 16 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.718728:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088c00/0x2bc3aa892c3a6d13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90a0 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.718738:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d0d888dee00) 00010000:00010000:1.0:1788582054.718752:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6cd4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9092 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.718780:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d888def00) 00010000:00010000:1.0:1788582054.718787:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788582054.718809:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a6dbb lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.718821:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a6dbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.718830:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a6dbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.718843:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a6dc2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.718850:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a6dc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.718857:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a6dc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.719309:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a6dc9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.719318:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a6dc9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.719325:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a6dc9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582054.720386:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788582054.720402:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a6dc9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.720723:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a6dc9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.720731:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a6dc9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.720737:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582054.720741:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a6dc9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.720748:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a6dc9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.720761:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff8d0da2faf900) 00010000:00010000:1.0:1788582054.720764:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1788582054.720768:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a6dc9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.720773:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a6dc9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.720795:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a6dbb lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.720802:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a6dbb lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.720808:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a6dbb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.720814:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fc800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582054.720822:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a6dbb lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.720829:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a6dbb lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.720837:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:1.0:1788582054.720839:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582054.720843:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a6dbb lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.720849:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a6dbb lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788582054.720861:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ca641d7f reply state 00000000f6ea05c9 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a6dc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582054.720871:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788582054.720969:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+15:9669:x1875464001966208:12345-192.168.201.12@tcp:36:rm.0 Request processed in 2363us (2699us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788582054.720978:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 31 00010000:00010000:1.0:1788582054.725302:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a6dc2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.725322:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a6dc2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.725330:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a6dc2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.725337:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fcc00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582054.725341:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a6dc2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.725362:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a6dc2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.725380:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff8d0da2fafe00) 00010000:00010000:1.0:1788582054.725384:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582054.725388:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a6dc2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582054.725395:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a6dc2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582055.405834:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab903b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020869504:0@lo:400:kworker.0 00000100:00100000:1.0:1788582055.405930:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582055.405990:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788582055.405997:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020869632:0@lo:400:kworker.0 00000100:00100000:1.0:1788582055.406027:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582055.406316:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020869248:0@lo:400:kworker.0 00000100:00100000:0.0:1788582055.406354:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582055.406379:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab900e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020869760:0@lo:400:kworker.0 00000100:00100000:1.0:1788582055.407699:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020869504 00000100:00100000:1.0:1788582055.407711:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020869504 00000100:00100000:1.0:1788582055.407784:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788582055.407795:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020869504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582055.407868:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020869504:12345-0@lo:400:kworker.0 Request processed in 75us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582055.407875:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788582055.407900:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020869632 00000100:00100000:1.0:1788582055.407905:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020869632 00000100:00100000:1.0:1788582055.407933:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788582055.407939:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020869632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582055.407987:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020869632:12345-0@lo:400:kworker.0 Request processed in 48us (1959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582055.407993:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:1.0:1788582055.408010:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788582055.408014:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788582055.408044:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dab901f80 x1875464020869632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788582055.408233:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582055.408277:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788582055.408287:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab901880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020869376:0@lo:400:kworker.0 00000100:00100000:0.0:1788582055.408319:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582055.408335:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020869888:0@lo:400:kworker.0 00000100:00100000:0.0:1788582055.408356:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582055.408433:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020869248 00000100:00100000:0.0:1788582055.408437:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020869248 00000100:00100000:0.0:1788582055.408465:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788582055.408471:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3306:x1875464020869248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582055.408503:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3306:x1875464020869248:12345-0@lo:400:kworker.0 Request processed in 33us (2148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582055.408509:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788582055.408533:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020869760 00000100:00100000:0.0:1788582055.408536:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020869760 00000100:00100000:0.0:1788582055.408559:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020869376 00000100:00100000:0.0:1788582055.408561:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020869376 00000100:00100000:0.0:1788582055.408589:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788582055.408594:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020869760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582055.408621:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020869760:12345-0@lo:400:kworker.0 Request processed in 27us (2221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582055.408627:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788582055.408636:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788582055.408902:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020869888 00000100:00100000:3.0:1788582055.408907:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020869888 00000100:00100000:3.0:1788582055.408933:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788582055.408940:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020869888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582055.408974:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020869888:12345-0@lo:400:kworker.0 Request processed in 35us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582055.408979:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788582055.409019:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020869376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582055.409046:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020869376:12345-0@lo:400:kworker.0 Request processed in 30us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582055.409104:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab901f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020869632:0@lo:400:kworker.0 00000100:00100000:1.0:1788582055.409122:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab903b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020869504:0@lo:400:kworker.0 00000100:00100000:1.0:1788582055.409156:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab98f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020870016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788582055.409183:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582055.409226:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020870016 00000100:00100000:1.0:1788582055.409230:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020870016 00000100:00100000:1.0:1788582055.409266:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788582055.409273:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020870016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788582055.409286:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788582055.409320:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc0a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020870016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582055.409337:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1788582055.409364:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dab98f100 x1875464020870016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582055.409378:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab98f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020870016:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788582055.409418:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788582055.409422:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788582055.409437:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab901880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020869376:0@lo:400:kworker.0 00010000:00080000:1.0:1788582055.409455:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dab901180 x1875464020869888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582055.409464:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab901180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020869888:0@lo:400:kworker.0 00000100:00100000:1.0:1788582055.409471:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab900a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020869248:0@lo:400:kworker.0 00000100:00100000:1.0:1788582055.409480:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab900e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020869760:0@lo:400:kworker.0 00000100:00100000:0.0:1788582055.428766:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00010000:3.0:1788582055.664454:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582056.693341:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582056.943360:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788582056.943453:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020870144:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788582056.943522:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582056.943584:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020870144 00000100:00100000:1.0:1788582056.943592:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020870144 00000100:00100000:1.0:1788582056.943650:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788582056.943660:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020870144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788582056.943700:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788582056.943742:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc09880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020870144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582056.943749:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788582056.943790:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dabc08a80 x1875464020870144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582072 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582056.943809:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020870144:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788582057.709540:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788582058.335976:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582058.336020:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582058.336076:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001966336 00000100:00100000:0.0:1788582058.336088:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001966336 00000100:00100000:3.0:1788582058.336119:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582058.336143:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582058.336146:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 244 00000100:00100000:0.0:1788582058.336157:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2351:x1875464001966336:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582058.336257:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2351:x1875464001966336:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 102us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582058.336265:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 244 00000100:00100000:2.0:1788582058.336346:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001966464 00000100:00100000:2.0:1788582058.336351:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001966464 00000100:00100000:2.0:1788582058.336393:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001966720 00000100:00100000:2.0:1788582058.336396:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001966720 00000100:00100000:2.0:1788582058.336414:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 88 00000100:00100000:2.0:1788582058.336420:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+14:2351:x1875464001966464:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788582058.336454:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+14:2351:x1875464001966464:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 34us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582058.336460:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 88 00000100:00100000:2.0:1788582058.336470:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 89 00000100:00100000:2.0:1788582058.336475:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2351:x1875464001966720:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788582058.336494:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2351:x1875464001966720:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 19us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582058.336500:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 89 00000100:00080000:0.0:1788582058.336880:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788582058.339392:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001966592 00000100:00100000:1.0:1788582058.339408:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001966592 00000100:00080000:0.0:1788582058.339543:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788582058.339985:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 43 00000100:00100000:1.0:1788582058.340002:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+5:2351:x1875464001966592:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582058.340119:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+5:2351:x1875464001966592:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 124us (4097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582058.340133:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 43 00010000:00010000:0.0:1788582058.735233:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788582058.781791:0:11618:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1788582059.759689:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788582059.940006:0:11667:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd3b9f6390 20000000:00000080:3.0:1788582059.940066:0:11667:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d0d90c3f800 uarg=0000000000000000 20000000:01000000:3.0:1788582059.940106:0:11667:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788582059.940113:0:11667:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788582059.940118:0:11667:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788582059.944865:0:11668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788582059.950401:0:11667:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1788582059.956114:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1788582059.956169:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1788582059.956272:0:11667:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1788582059.956292:0:11667:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788582059.956313:0:11667:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d0dbbe04800/0x2bc3aa892c3a6dd0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.956331:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d8167c800/0x2bc3aa892c3a6c79 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6c72 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.956339:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0da7088200/0x2bc3aa892c3a6c87 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6c80 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.956346:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0dbbe05400/0x2bc3aa892c3a6c95 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6c8e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.956356:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d8167d800/0x2bc3aa892c3a6c9c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c907d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.956363:0:11667:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a6ca3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9084 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.956371:0:11667:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d0dbbe04800/0x2bc3aa892c3a6dd0 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.956412:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a6ca3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9084 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.956428:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a6ca3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9084 expref: 12 pid: 5836 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582059.956457:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2da300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875464020870272:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582059.956561:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d8167d800/0x2bc3aa892c3a6c9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c907d expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.956571:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d0d8167d800/0x2bc3aa892c3a6c9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c907d expref: 12 pid: 5836 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582059.956580:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2d9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875464020870400:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582059.956625:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0dbbe05400/0x2bc3aa892c3a6c95 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a6c8e expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.956632:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0dbbe05400/0x2bc3aa892c3a6c95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c8e expref: 18 pid: 5838 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582059.956640:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2d8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875464020870528:0@lo:104: 00000100:00100000:2.0:1788582059.956685:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788582059.956731:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0da7088200/0x2bc3aa892c3a6c87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a6c80 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.956739:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0da7088200/0x2bc3aa892c3a6c87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c80 expref: 18 pid: 5838 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582059.956747:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2d8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875464020870656:0@lo:104: 00000100:00100000:2.0:1788582059.956768:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788582059.956873:0:11667:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d8167c800/0x2bc3aa892c3a6c79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a6c72 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.956881:0:11667:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff8d0d8167c800/0x2bc3aa892c3a6c79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c72 expref: 18 pid: 5838 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582059.956896:0:11667:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875464020870784:0@lo:104: 00000100:00100000:2.0:1788582059.956921:0:11667:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582059.960007:0:11667:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbfb25840 going to sleep for 11 seconds 00000100:00100000:3.0:1788582059.961488:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582059.961521:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001966848 00000100:00100000:3.0:1788582059.961530:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001966848 00010000:00010000:3.0:1788582059.961567:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a6ca3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9084 expref: 13 pid: 5836 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582059.961624:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 30 00000100:00100000:3.0:1788582059.961635:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2350:x1875464001966848:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582059.961650:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582059.961655:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a6ca3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9084 expref: 13 pid: 5836 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582059.961667:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a6ca3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9084 expref: 13 pid: 5836 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582059.961687:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582059.961734:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd93b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2350:x1875464001966848:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 101us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582059.961741:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 30 00010000:00010000:2.0:1788582059.962393:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a6ca3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9084 expref: 12 pid: 5836 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582059.962411:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2da300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875464020870272:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582059.962425:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2d9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875464020870400:192.168.201.12@tcp:104: 00000100:00100000:1.0:1788582059.962488:0:5827:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788582059.962503:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020870528 00000100:00100000:1.0:1788582059.962508:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020870528 00000100:00100000:1.0:1788582059.962535:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020870656 00000100:00100000:1.0:1788582059.962538:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020870656 00000100:00100000:1.0:1788582059.962546:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020870784 00000100:00100000:1.0:1788582059.962548:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020870784 00000100:00100000:1.0:1788582059.962559:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788582059.962565:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+5:11667:x1875464020870528:12345-0@lo:104: 00010000:00010000:1.0:1788582059.962581:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0da7088400/0x2bc3aa892c3a6c8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6c95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582059.962659:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788582059.962665:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+5:11667:x1875464020870528:12345-0@lo:104: Request processed in 100us (5981us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582059.962671:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788582059.962687:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00010000:00010000:3.0:1788582059.962689:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788582059.962695:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+4:11667:x1875464020870656:12345-0@lo:104: 00010000:00010000:3.0:1788582059.962700:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0da7088400/0x2bc3aa892c3a6c8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6c95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582059.962704:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6c87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582059.962716:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088400 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:3.0:1788582059.962736:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0da7088400/0x2bc3aa892c3a6c8e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a6c95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582059.962747:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0da7088400/0x2bc3aa892c3a6c8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a6c95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582059.962752:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 10000000:00010000:3.0:1788582059.962755:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0da7088400/0x2bc3aa892c3a6c8e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a6c95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582059.962760:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+4:11667:x1875464020870656:12345-0@lo:104: Request processed in 67us (5990us total) trans 0 rc 0/0 10000000:01000000:3.0:1788582059.962770:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788582059.962775:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788582059.962790:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788582059.962805:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:11667:x1875464020870784:12345-0@lo:104: 00010000:00010000:1.0:1788582059.962813:0:5827:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27400/0x2bc3aa892c3a6c72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6c79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582059.962815:0:7637:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0da7088400/0x2bc3aa892c3a6c8e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6c95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582059.962827:0:7637:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788582059.962852:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0da7088400/0x2bc3aa892c3a6c8e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6c95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582059.962858:0:5827:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:3.0:1788582059.962860:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0da7088400/0x2bc3aa892c3a6c8e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6c95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582059.962866:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+3:11667:x1875464020870784:12345-0@lo:104: Request processed in 61us (5942us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582059.962877:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788582059.962883:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788582059.962888:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6c87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582059.962895:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8167d400 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:3.0:1788582059.962899:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c80 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a6c87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582059.962907:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a6c87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582059.962914:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788582059.962922:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27400/0x2bc3aa892c3a6c72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a6c79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582059.962932:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27400 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:1.0:1788582059.962936:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27400/0x2bc3aa892c3a6c72 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a6c79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582059.962944:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27400/0x2bc3aa892c3a6c72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a6c79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788582059.962948:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c80 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a6c87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788582059.962950:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27400/0x2bc3aa892c3a6c72 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a6c79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788582059.962965:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788582059.962967:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788582059.962989:0:5831:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27400/0x2bc3aa892c3a6c72 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6c79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582059.962995:0:5831:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788582059.962998:0:7637:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c80 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6c87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582059.963002:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27400/0x2bc3aa892c3a6c72 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6c79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582059.963019:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27400/0x2bc3aa892c3a6c72 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6c79 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582059.963028:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582059.963030:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582059.963032:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582059.963055:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582059.963103:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020870912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788582059.963138:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582059.963176:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788582059.963182:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020871040:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788582059.963332:0:7637:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788582059.963352:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c80 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6c87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582059.963360:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d8167d400/0x2bc3aa892c3a6c80 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a6c87 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582059.963374:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582059.963375:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582059.963377:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788582059.963392:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020870912 00000100:00100000:3.0:1788582059.963398:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020870912 00010000:00010000:3.0:1788582059.963419:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0dbbe05400/0x2bc3aa892c3a6c95 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c8e expref: 19 pid: 5838 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582059.963442:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788582059.963451:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3306:x1875464020870912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788582059.963462:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582059.963466:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0dbbe05400/0x2bc3aa892c3a6c95 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c8e expref: 19 pid: 5838 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582059.963477:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0dbbe05400/0x2bc3aa892c3a6c95 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c8e expref: 19 pid: 5838 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582059.963488:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2d8e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875464020870528:0@lo:104: 00010000:00010000:3.0:1788582059.963499:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0dbbe05400/0x2bc3aa892c3a6c95 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c8e expref: 19 pid: 5838 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582059.963503:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2d8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875464020870656:0@lo:104: 00010000:00010000:3.0:1788582059.963517:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582059.963521:0:11667:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11667:1875464020870784:0@lo:104: 00000100:00100000:3.0:1788582059.963553:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:3306:x1875464020870912:12345-0@lo:103:ldlm_bl.0 Request processed in 103us (413us total) trans 0 rc 0/0 00010000:00010000:2.0:1788582059.963557:0:11667:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d0dbbe04800/0x2bc3aa892c3a6dd0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582059.963563:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788582059.963603:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020871168:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788582059.963642:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582059.963690:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020871168 00000100:00100000:3.0:1788582059.963694:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020871168 00010000:00010000:3.0:1788582059.963708:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0da7088200/0x2bc3aa892c3a6c87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c80 expref: 18 pid: 5838 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582059.963735:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788582059.963742:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d86670450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:3308:x1875464020871168:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788582059.963749:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582059.963753:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0da7088200/0x2bc3aa892c3a6c87 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c80 expref: 18 pid: 5838 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582059.963762:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0da7088200/0x2bc3aa892c3a6c87 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c80 expref: 18 pid: 5838 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582059.963772:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0da7088200/0x2bc3aa892c3a6c87 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c80 expref: 18 pid: 5838 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582059.963780:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582059.963806:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d86670450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:3308:x1875464020871168:12345-0@lo:103:ldlm_bl.0 Request processed in 65us (165us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582059.963819:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788582059.963867:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020871168:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788582059.964395:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582059.964439:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020870912:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788582059.964506:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020871040 00000100:00100000:0.0:1788582059.964511:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020871040 00010000:00010000:0.0:1788582059.964535:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d8167c800/0x2bc3aa892c3a6c79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c72 expref: 17 pid: 5838 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582059.964569:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788582059.964577:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:3306:x1875464020871040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788582059.964607:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582059.964613:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d8167c800/0x2bc3aa892c3a6c79 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c72 expref: 17 pid: 5838 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582059.964624:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d8167c800/0x2bc3aa892c3a6c79 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c72 expref: 17 pid: 5838 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582059.964637:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8167c800/0x2bc3aa892c3a6c79 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a6c72 expref: 17 pid: 5838 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582059.964649:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788582059.964729:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc08700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:3306:x1875464020871040:12345-0@lo:103:ldlm_bl.0 Request processed in 153us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582059.964736:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788582059.964796:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020871040:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788582059.964876:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582059.965112:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001966976 00000100:00100000:2.0:1788582059.965117:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001966976 00010000:00010000:2.0:1788582059.965139:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d8167d800/0x2bc3aa892c3a6c9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c907d expref: 12 pid: 5836 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582059.965170:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 34 00000100:00100000:2.0:1788582059.965178:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:2350:x1875464001966976:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788582059.965187:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582059.965192:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d8167d800/0x2bc3aa892c3a6c9c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c907d expref: 12 pid: 5836 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.965230:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d8167d800/0x2bc3aa892c3a6c9c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c907d expref: 12 pid: 5836 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.965252:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8167d800/0x2bc3aa892c3a6c9c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c907d expref: 12 pid: 5836 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.965267:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d0dbbe04800/0x2bc3aa892c3a6dd0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.965275:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0dbbe04800/0x2bc3aa892c3a6dd0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.965289:0:7636:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0dbbe04800/0x2bc3aa892c3a6dd0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.965296:0:7636:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0dbbe04800/0x2bc3aa892c3a6dd0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.965303:0:7636:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d0dbbe04800/0x2bc3aa892c3a6dd0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.965309:0:7636:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d0dbbe04800/0x2bc3aa892c3a6dd0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.965315:0:7636:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04800 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582059.965319:0:7636:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d0dbbe04800/0x2bc3aa892c3a6dd0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.965326:0:7636:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d0dbbe04800/0x2bc3aa892c3a6dd0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.965351:0:7636:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d0dbbe04800/0x2bc3aa892c3a6dd0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582059.965372:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788582059.965416:0:11667:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d0dbbe04800/0x2bc3aa892c3a6dd0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582059.965427:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:05a4b000-bb80-4acb-83cf-d9c3916564a8+11:2350:x1875464001966976:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 249us (551us total) trans 0 rc 0/0 00010000:00010000:0.0:1788582059.965428:0:11667:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d0dbbe04800/0x2bc3aa892c3a6dd0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582059.965442:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 34 00010000:00010000:0.0:1788582059.965443:0:11667:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0dbbe04800/0x2bc3aa892c3a6dd0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11667 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788582060.093737:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1788582060.093793:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788582060.093990:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788582060.094010:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020871296:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788582060.094078:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582060.094168:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020871296 00000100:00100000:1.0:1788582060.094175:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020871296 00000100:00100000:1.0:1788582060.094256:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788582060.094267:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020871296:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788582060.094294:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1788582060.094329:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a9b98a6, atime: 0x6a9b98a6, ctime: 0x6a9b98a6, blocks: 0x1 00010000:00010000:1.0:1788582060.094337:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8bbc1dc/0x2bc3aa892c3a6dd7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582060.094353:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=279s v=(0 0) 00010000:00010000:1.0:1788582060.094357:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582060.094375:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8bbc1dc/0x2bc3aa892c3a6dd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582060.094392:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8bbc1dc/0x2bc3aa892c3a6dd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582060.094401:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8bbc1dc/0x2bc3aa892c3a6dd7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582060.094408:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8bbc1dc/0x2bc3aa892c3a6dd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582060.094425:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788582060.094859:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875464020871296:12345-0@lo:6:osp-syn-1-0.0 Request processed in 593us (780us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788582060.094867:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1788582060.094895:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788582060.094901:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8bbc1dc/0x2bc3aa892c3a6dd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582060.094910:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fc400 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582060.094915:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8bbc1dc/0x2bc3aa892c3a6dd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582060.094923:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8bbc1dc/0x2bc3aa892c3a6dd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582060.094951:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8bbc1dc/0x2bc3aa892c3a6dd7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582060.094959:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8bbc1dc/0x2bc3aa892c3a6dd7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582060.094978:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582060.094980:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582060.094982:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788582060.095015:0:3308:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d0dabc08a80/2, rc 0, transno 4294967300 00000100:00100000:1.0:1788582060.095022:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabc08a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020871296:0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1788582060.095190:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788582060.525658:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020871424:0@lo:400:kworker.0 00000100:00100000:1.0:1788582060.525791:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582060.525870:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020871936:0@lo:400:kworker.0 00000100:00100000:1.0:1788582060.525894:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582060.525919:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788582060.525924:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020871552:0@lo:400:kworker.0 00000100:00100000:1.0:1788582060.525940:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582060.525960:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020871680:0@lo:400:kworker.0 00000100:00100000:1.0:1788582060.525991:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582060.526007:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788582060.526012:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbc58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020871808:0@lo:400:kworker.0 00000100:00100000:1.0:1788582060.526030:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582060.526055:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020871936 00000100:00100000:1.0:1788582060.526072:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020871936 00000100:00100000:1.0:1788582060.526116:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020871552 00000100:00100000:1.0:1788582060.526118:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020871552 00000100:00100000:1.0:1788582060.526130:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020871680 00000100:00100000:1.0:1788582060.526131:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020871680 00000100:00100000:1.0:1788582060.526146:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788582060.526165:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020871936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582060.526239:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020871936:12345-0@lo:400:kworker.0 Request processed in 74us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582060.526246:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788582060.526271:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788582060.526277:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020871552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582060.526299:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020871552:12345-0@lo:400:kworker.0 Request processed in 23us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582060.526304:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788582060.526313:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788582060.526318:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020871680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582060.526340:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020871680:12345-0@lo:400:kworker.0 Request processed in 22us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582060.526345:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1788582060.526362:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788582060.526387:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020871680:0@lo:400:kworker.0 00000100:00100000:1.0:1788582060.526410:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020871552:0@lo:400:kworker.0 00000100:00100000:1.0:1788582060.526417:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020871936:0@lo:400:kworker.0 00000100:00100000:1.0:1788582060.526446:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020871808 00000100:00100000:1.0:1788582060.526449:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020871808 00000100:00100000:1.0:1788582060.526481:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788582060.526486:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020871808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582060.526515:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020871808:12345-0@lo:400:kworker.0 Request processed in 29us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582060.526521:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788582060.526533:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788582060.526547:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbbc58000 x1875464020871808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582060.526558:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbc58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020871808:0@lo:400:kworker.0 00000100:00100000:0.0:1788582060.526882:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788582060.526891:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab98f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020872064:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788582060.526922:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582060.526945:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020872064 00000100:00100000:3.0:1788582060.526950:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020872064 00000100:00100000:3.0:1788582060.526998:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788582060.527006:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875464020872064:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788582060.527032:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788582060.527083:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1875464020872064:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582060.527089:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788582060.527399:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab98f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020872064:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788582060.530456:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020871424 00000100:00100000:2.0:1788582060.530471:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020871424 00000100:00100000:2.0:1788582060.530624:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1788582060.530637:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:3306:x1875464020871424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582060.531518:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:3306:x1875464020871424:12345-0@lo:400:kworker.0 Request processed in 881us (5723us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582060.531538:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788582060.531655:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020871424:0@lo:400:kworker.0 00010000:00010000:1.0:1788582060.781610:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788582061.404505:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582061.404654:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001967104 00000100:00100000:2.0:1788582061.404666:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001967104 00000100:00100000:2.0:1788582061.404729:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 246 00000100:00100000:2.0:1788582061.404742:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+11:5589:x1875464001967104:12345-192.168.201.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788582061.404766:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582061.404788:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0dbbe04c00/0x2bc3aa892c3a6dde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c90d1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582061.404819:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0dbbe04c00/0x2bc3aa892c3a6dde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90d1 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582061.404832:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0dbbe04c00/0x2bc3aa892c3a6dde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90d1 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582061.404855:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04c00, rc 0) 00000100:00100000:2.0:1788582061.404931:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:5589:x1875464001967104:12345-192.168.201.12@tcp:101:ll_cfg_requeue.0 Request processed in 191us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582061.404939:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 246 00000100:00100000:1.0:1788582061.408438:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582061.408539:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001967232 00000100:00100000:2.0:1788582061.408550:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001967232 00000100:00100000:2.0:1788582061.408621:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 247 00000100:00100000:2.0:1788582061.408632:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:5589:x1875464001967232:12345-192.168.201.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788582061.408932:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:5589:x1875464001967232:12345-192.168.201.12@tcp:501:ll_cfg_requeue.0 Request processed in 301us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582061.408941:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 247 00000100:00100000:3.0:1788582061.413450:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582061.413573:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001967360 00000100:00100000:0.0:1788582061.413602:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001967360 00000100:00100000:0.0:1788582061.413673:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 248 00000100:00100000:0.0:1788582061.413683:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:5589:x1875464001967360:12345-192.168.201.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788582061.413929:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:5589:x1875464001967360:12345-192.168.201.12@tcp:503:ll_cfg_requeue.0 Request processed in 245us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582061.413938:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 248 00000100:00100000:3.0:1788582061.429177:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582061.433180:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001967488 00000100:00100000:0.0:1788582061.433197:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001967488 00000100:00100000:0.0:1788582061.433323:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 249 00000100:00100000:0.0:1788582061.433333:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:9940:x1875464001967488:12345-192.168.201.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788582061.433630:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:9940:x1875464001967488:12345-192.168.201.12@tcp:502:llog_process_th.0 Request processed in 297us (4463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582061.433639:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 249 00000100:00100000:1.0:1788582061.448477:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582061.448578:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001967616 00000100:00100000:2.0:1788582061.448588:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001967616 00000100:00100000:2.0:1788582061.448650:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 250 00000100:00100000:2.0:1788582061.448662:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:9940:x1875464001967616:12345-192.168.201.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788582061.448944:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:9940:x1875464001967616:12345-192.168.201.12@tcp:502:llog_process_th.0 Request processed in 284us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582061.448959:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 250 00000100:00100000:3.0:1788582061.474718:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582061.476463:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001967744 00000100:00100000:2.0:1788582061.476481:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001967744 00000100:00100000:2.0:1788582061.476556:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 251 00000100:00100000:2.0:1788582061.476578:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:5589:x1875464001967744:12345-192.168.201.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788582061.476598:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582061.476619:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0dbbe04000/0x2bc3aa892c3a6de5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c90d8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582061.476677:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0dbbe04000/0x2bc3aa892c3a6de5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90d8 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582061.476689:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0dbbe04000/0x2bc3aa892c3a6de5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90d8 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582061.476700:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04000, rc 0) 00000100:00100000:2.0:1788582061.477637:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:5589:x1875464001967744:12345-192.168.201.12@tcp:101:ll_cfg_requeue.0 Request processed in 1066us (2923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582061.477647:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 251 00000100:00100000:3.0:1788582061.482044:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582061.482248:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001967872 00000100:00100000:2.0:1788582061.482262:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001967872 00000100:00100000:2.0:1788582061.482326:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 252 00000100:00100000:2.0:1788582061.482336:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:5589:x1875464001967872:12345-192.168.201.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788582061.482923:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:5589:x1875464001967872:12345-192.168.201.12@tcp:501:ll_cfg_requeue.0 Request processed in 324us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582061.482933:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 252 00000100:00100000:1.0:1788582061.485743:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582061.485872:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001968000 00000100:00100000:2.0:1788582061.485882:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001968000 00000100:00100000:2.0:1788582061.485994:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 253 00000100:00100000:2.0:1788582061.486004:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:5589:x1875464001968000:12345-192.168.201.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788582061.486271:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:5589:x1875464001968000:12345-192.168.201.12@tcp:503:ll_cfg_requeue.0 Request processed in 267us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582061.486279:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 253 00000100:00100000:3.0:1788582061.493383:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582061.499251:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001968128 00000100:00100000:0.0:1788582061.499270:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001968128 00000100:00100000:0.0:1788582061.499329:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 254 00000100:00100000:0.0:1788582061.499340:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:9943:x1875464001968128:12345-192.168.201.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788582061.499621:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:9943:x1875464001968128:12345-192.168.201.12@tcp:502:llog_process_th.0 Request processed in 281us (6250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582061.499630:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 254 00000100:00100000:3.0:1788582061.512242:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582061.513237:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001968256 00000100:00100000:0.0:1788582061.513251:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001968256 00000100:00100000:0.0:1788582061.513304:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 255 00000100:00100000:0.0:1788582061.513314:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:9943:x1875464001968256:12345-192.168.201.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788582061.513635:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90f8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:9943:x1875464001968256:12345-192.168.201.12@tcp:502:llog_process_th.0 Request processed in 320us (1401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582061.513650:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 255 10000000:01000000:0.0:1788582061.549483:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788582061.549491:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0dbf4ee800 from 7 10000000:01000000:0.0:1788582061.549496:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788582061.549546:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7089a00/0x2bc3aa892c3a6dec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582061.549557:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0da7089a00/0x2bc3aa892c3a6dec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582061.549578:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0da7089a00/0x2bc3aa892c3a6dec lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582061.549603:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab98f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020872192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788582061.549675:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582061.549784:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dac24a900 going to sleep for 11 seconds 00000100:00100000:2.0:1788582061.551756:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020872192 00000100:00100000:2.0:1788582061.551789:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020872192 00000100:00100000:2.0:1788582061.551855:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788582061.551866:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:5840:x1875464020872192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788582061.551883:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582061.551901:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0dbbe04200/0x2bc3aa892c3a6df3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6dec expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582061.551941:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0dbbe04200/0x2bc3aa892c3a6df3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6dec expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582061.551961:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0dbbe04200/0x2bc3aa892c3a6df3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6dec expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582061.551972:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04200, rc 0) 00000100:00100000:2.0:1788582061.552670:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3336450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020872192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 793us (2982us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582061.552679:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1788582061.553180:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab98f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020872192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788582061.553232:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0da7089a00/0x2bc3aa892c3a6dec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6df3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582061.553244:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0da7089a00/0x2bc3aa892c3a6dec lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6df3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582061.553326:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabc09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020872320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788582061.553368:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582061.553411:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8da000 going to sleep for 11 seconds 00000100:00100000:2.0:1788582061.553726:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020872320 00000100:00100000:2.0:1788582061.553732:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020872320 00000100:00100000:2.0:1788582061.553779:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:2.0:1788582061.553788:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020872320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788582061.554132:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3334850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020872320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 343us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582061.554140:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788582061.554449:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabc09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020872320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788582061.554509:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabc09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020872448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788582061.554549:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582061.554588:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8da000 going to sleep for 11 seconds 00000100:00100000:2.0:1788582061.555401:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020872448 00000100:00100000:2.0:1788582061.555409:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020872448 00000100:00100000:2.0:1788582061.555470:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1788582061.555480:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020872448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788582061.555724:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3335850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020872448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 245us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582061.555732:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788582061.555842:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabc09180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020872448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788582061.557041:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabc0ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:11681:1875464020872576:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788582061.557100:0:11681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582061.557142:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8dac00 going to sleep for 11 seconds 00000100:00100000:0.0:1788582061.557274:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020872576 00000100:00100000:0.0:1788582061.557282:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020872576 00000100:00100000:0.0:1788582061.557329:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788582061.557338:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:11681:x1875464020872576:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788582061.557550:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3336850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:11681:x1875464020872576:12345-0@lo:502:llog_process_th.0 Request processed in 212us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582061.557558:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788582061.558122:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabc0ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:11681:1875464020872576:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788582061.558157:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788582061.558168:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788582061.558170:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788582061.558176:0:11681:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d0dbf4ee800 00000020:00000080:1.0:1788582061.558178:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788582061.558303:0:11681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabc0ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:11681:1875464020872704:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788582061.558344:0:11681:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582061.558377:0:11681:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8dac00 going to sleep for 11 seconds 00000100:00100000:2.0:1788582061.558437:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020872704 00000100:00100000:2.0:1788582061.558442:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020872704 00000100:00100000:2.0:1788582061.558483:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1788582061.558492:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:11681:x1875464020872704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788582061.558683:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3335c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:11681:x1875464020872704:12345-0@lo:502:llog_process_th.0 Request processed in 192us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582061.558691:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788582061.559246:0:11681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabc0ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:11681:1875464020872704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788582061.559274:0:11681:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788582061.559281:0:11681:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788582061.559284:0:11681:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788582061.559287:0:11681:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788582061.559801:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788582061.559825:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788582061.559837:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7089a00/0x2bc3aa892c3a6dec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6df3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582061.559849:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0da7089a00/0x2bc3aa892c3a6dec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6df3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788582061.559862:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788582061.559865:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0dac39a800 from 7 10000000:01000000:2.0:1788582061.559868:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788582061.559903:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04400/0x2bc3aa892c3a6dfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582061.560113:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04400/0x2bc3aa892c3a6dfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582061.560124:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04400/0x2bc3aa892c3a6dfa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582061.560161:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbc59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020872832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788582061.560246:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582061.560331:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dab9c2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788582061.575695:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020872832 00000100:00100000:0.0:1788582061.575717:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020872832 00000100:00100000:0.0:1788582061.575817:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788582061.575845:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:5840:x1875464020872832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788582061.575869:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582061.575893:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0da7088e00/0x2bc3aa892c3a6e01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6dfa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582061.575940:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0da7088e00/0x2bc3aa892c3a6e01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6dfa expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582061.576179:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0da7088e00/0x2bc3aa892c3a6e01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6dfa expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582061.576195:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7088e00, rc 0) 00000100:00100000:0.0:1788582061.576299:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3334c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020872832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 457us (16053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582061.576306:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1788582061.576418:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbc59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020872832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788582061.576437:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04400/0x2bc3aa892c3a6dfa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6e01 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582061.576447:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04400/0x2bc3aa892c3a6dfa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6e01 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582061.576516:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbc59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020872960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788582061.576548:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582061.576593:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dab9c2b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788582061.576768:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020872960 00000100:00100000:0.0:1788582061.576773:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020872960 00000100:00100000:0.0:1788582061.576811:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788582061.576817:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020872960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788582061.577673:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3335050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020872960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 850us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582061.577684:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788582061.581762:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbc59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020872960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788582061.581930:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbc59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020873088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788582061.582027:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582061.582071:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dab9c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788582061.582197:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020873088 00000100:00100000:0.0:1788582061.582229:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020873088 00000100:00100000:0.0:1788582061.582280:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788582061.582289:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020873088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788582061.582497:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3337850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020873088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 208us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582061.582513:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788582061.582870:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbc59c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020873088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788582061.584292:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab98e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:11684:1875464020873216:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788582061.584363:0:11684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582061.584409:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da9a91000 going to sleep for 11 seconds 00000100:00100000:2.0:1788582061.584491:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020873216 00000100:00100000:2.0:1788582061.584500:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020873216 00000100:00100000:2.0:1788582061.584548:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788582061.584569:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:11684:x1875464020873216:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788582061.584803:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3334450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:11684:x1875464020873216:12345-0@lo:502:llog_process_th.0 Request processed in 243us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582061.584811:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788582061.585139:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab98e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:11684:1875464020873216:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788582061.585171:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788582061.585184:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788582061.585187:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788582061.585194:0:11684:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d0dac39a800 00000020:00000080:0.0:1788582061.585197:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788582061.585308:0:11684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab98e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:11684:1875464020873344:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788582061.585348:0:11684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582061.585372:0:11684:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85a33000 going to sleep for 11 seconds 00000100:00100000:2.0:1788582061.586786:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020873344 00000100:00100000:2.0:1788582061.586806:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020873344 00000100:00100000:2.0:1788582061.586866:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1788582061.586875:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:11684:x1875464020873344:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788582061.587349:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3335450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:11684:x1875464020873344:12345-0@lo:502:llog_process_th.0 Request processed in 473us (1997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582061.587357:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788582061.587491:0:11684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab98e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:11684:1875464020873344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788582061.587522:0:11684:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788582061.587529:0:11684:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788582061.587531:0:11684:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788582061.587535:0:11684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1788582061.588254:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1788582061.588276:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788582061.588286:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04400/0x2bc3aa892c3a6dfa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6e01 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582061.588298:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04400/0x2bc3aa892c3a6dfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6e01 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788582061.588309:0:5840:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788582061.588311:0:5840:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0d945e5800 from 7 10000000:01000000:2.0:1788582061.588314:0:5840:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788582061.588351:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05c00/0x2bc3aa892c3a6e08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582061.588359:0:5840:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05c00/0x2bc3aa892c3a6e08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582061.588369:0:5840:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05c00/0x2bc3aa892c3a6e08 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582061.588403:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbc5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020873472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788582061.588443:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582061.588472:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dab9c2480 going to sleep for 11 seconds 00000100:00100000:0.0:1788582061.588806:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020873472 00000100:00100000:0.0:1788582061.588814:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020873472 00000100:00100000:0.0:1788582061.588860:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788582061.588869:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:5840:x1875464020873472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788582061.588882:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582061.588896:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0da7088800/0x2bc3aa892c3a6e0f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a6e08 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582061.588955:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0da7088800/0x2bc3aa892c3a6e0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6e08 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582061.588966:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0da7088800/0x2bc3aa892c3a6e0f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a6e08 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582061.588975:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7088800, rc 0) 00000100:00100000:0.0:1788582061.589026:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3336050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020873472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582061.589033:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788582061.590147:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbc5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020873472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788582061.590179:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05c00/0x2bc3aa892c3a6e08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6e0f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582061.590190:0:5840:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05c00/0x2bc3aa892c3a6e08 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6e0f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582061.590277:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbc5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020873600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788582061.590322:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582061.590353:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dab9c2480 going to sleep for 11 seconds 00000100:00100000:0.0:1788582061.590814:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020873600 00000100:00100000:0.0:1788582061.590822:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020873600 00000100:00100000:0.0:1788582061.590877:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788582061.590887:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020873600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788582061.591402:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3334050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020873600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 514us (1076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582061.591411:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1788582061.592287:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbc5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020873600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788582061.592339:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbc5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020873728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788582061.592384:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582061.592417:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dab9c2480 going to sleep for 11 seconds 00000100:00100000:0.0:1788582061.594337:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020873728 00000100:00100000:0.0:1788582061.594351:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020873728 00000100:00100000:0.0:1788582061.594410:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788582061.594422:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020873728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788582061.594687:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3337450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:5840:x1875464020873728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 266us (2301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582061.594696:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1788582061.595986:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbc5a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:5840:1875464020873728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788582061.598759:0:11686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabc0ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:11686:1875464020873856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788582061.598851:0:11686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1788582061.599439:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788582061.607633:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020873856 00000100:00100000:2.0:1788582061.607651:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020873856 00000100:00100000:2.0:1788582061.607707:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788582061.607720:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:11686:x1875464020873856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788582061.608311:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3337c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:11686:x1875464020873856:12345-0@lo:502:llog_process_th.0 Request processed in 591us (9458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582061.608321:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1788582061.613389:0:11686:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8da000 going to sleep for 11 seconds 00000100:00100000:0.0:1788582061.613433:0:11686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabc0ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:11686:1875464020873856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788582061.613491:0:11686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788582061.613501:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788582061.613504:0:11686:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788582061.613510:0:11686:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d0d945e5800 00000020:00000080:0.0:1788582061.613513:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788582061.613640:0:11686:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab98e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:11686:1875464020873984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788582061.613711:0:11686:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582061.613747:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020873984 00000100:00100000:0.0:1788582061.613754:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020873984 00000100:00100000:2.0:1788582061.618267:0:11686:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85a33b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788582061.619178:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788582061.619220:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:11686:x1875464020873984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788582061.619516:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3337050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:11686:x1875464020873984:12345-0@lo:502:llog_process_th.0 Request processed in 325us (5804us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582061.619525:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788582061.620436:0:11686:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab98e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:11686:1875464020873984:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788582061.620475:0:11686:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788582061.620488:0:11686:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788582061.620492:0:11686:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788582061.620497:0:11686:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1788582061.623156:0:5840:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1788582061.623195:0:5840:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788582061.623228:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05c00/0x2bc3aa892c3a6e08 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6e0f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582061.623253:0:5840:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05c00/0x2bc3aa892c3a6e08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6e0f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582061.805449:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788582062.061551:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788582062.061682:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020874112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788582062.061754:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582062.062231:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020874112 00000100:00100000:0.0:1788582062.062239:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020874112 00000100:00100000:0.0:1788582062.062491:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788582062.062502:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020874112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788582062.062539:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582062.062611:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020874112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582062.062618:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788582062.062699:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dabc08000 x1875464020874112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582062.062718:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020874112:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788582062.062803:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1788582062.638013:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788582062.829441:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788582063.454427:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582063.454472:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582063.454513:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582063.454583:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582063.454624:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001968640 00000100:00100000:3.0:1788582063.454633:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001968640 00000100:00100000:3.0:1788582063.454703:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 45 00000100:00100000:3.0:1788582063.454715:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+5:2349:x1875464001968640:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582063.454796:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+5:2349:x1875464001968640:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 82us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582063.454804:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 45 00000100:00100000:2.0:1788582063.454826:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001968512 00000100:00100000:2.0:1788582063.454831:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001968512 00000100:00100000:2.0:1788582063.454861:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001968768 00000100:00100000:2.0:1788582063.454865:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001968768 00000100:00100000:2.0:1788582063.454884:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 93 00000100:00100000:2.0:1788582063.454891:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+5:2349:x1875464001968512:12345-192.168.201.12@tcp:400:kworker.0 00000100:00080000:3.0:1788582063.454903:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788582063.454908:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788582063.454926:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+5:2349:x1875464001968512:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 35us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582063.454932:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 93 00000100:00100000:3.0:1788582063.454944:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 94 00000100:00100000:0.0:1788582063.455006:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001968384 00000100:00100000:0.0:1788582063.455011:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001968384 00000100:00100000:0.0:1788582063.455042:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 271 00000100:00100000:0.0:1788582063.455048:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3330850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2349:x1875464001968384:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582063.456222:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3330850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2349:x1875464001968384:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 28us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582063.456257:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 271 00000100:00100000:3.0:1788582063.457702:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2349:x1875464001968768:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582063.457819:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2349:x1875464001968768:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 2865us (3343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582063.457830:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 94 00010000:00010000:1.0:1788582063.857653:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582064.877572:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788582065.258469:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:1.0:1788582065.647729:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788582065.650104:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875464020874496:0@lo:400:kworker.0 00000100:00100000:2.0:1788582065.650180:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582065.650269:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788582065.650276:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020874368:0@lo:400:kworker.0 00000100:00100000:2.0:1788582065.650307:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582065.650358:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020874368 00000100:00100000:2.0:1788582065.650366:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020874368 00000100:00100000:2.0:1788582065.650419:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788582065.650428:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3331850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3307:x1875464020874368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582065.650478:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3331850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3307:x1875464020874368:12345-0@lo:400:kworker.0 Request processed in 51us (169us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582065.650517:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788582065.650563:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020874368:0@lo:400:kworker.0 00000100:00100000:0.0:1788582065.652139:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020874496 00000100:00100000:0.0:1788582065.652159:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020874496 00000100:00100000:0.0:1788582065.652236:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788582065.652245:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875464020874496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582065.652324:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc5a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875464020874496:12345-0@lo:400:kworker.0 Request processed in 80us (2144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582065.652331:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788582065.652371:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875464020874496:0@lo:400:kworker.0 00000100:00100000:1.0:1788582065.655381:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020874624:0@lo:400:kworker.0 00000100:00100000:1.0:1788582065.655465:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582065.655535:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab98ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020874240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788582065.655564:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582065.655750:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020874240 00000100:00100000:0.0:1788582065.655759:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020874240 00000100:00100000:0.0:1788582065.655833:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788582065.655844:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020874240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788582065.655884:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582065.655930:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020874240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582065.655938:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788582065.656019:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020874624 00000100:00100000:2.0:1788582065.656023:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020874624 00000100:00100000:2.0:1788582065.656063:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788582065.656071:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020874624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582065.656110:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc09500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020874624:12345-0@lo:400:kworker.0 Request processed in 41us (645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582065.656116:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:1.0:1788582065.656335:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788582065.656340:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788582065.656370:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020874624:0@lo:400:kworker.0 00000100:00100000:1.0:1788582065.656382:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1788582065.656387:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d0dabc08a80, transno 4294967300 00000100:00100000:1.0:1788582065.656423:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab98ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020874240:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788582065.657432:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020874752:0@lo:400:kworker.0 00000100:00100000:2.0:1788582065.657505:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582065.657660:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020874752 00000100:00100000:3.0:1788582065.657669:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020874752 00000100:00100000:3.0:1788582065.657750:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788582065.657762:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020874752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582065.657809:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020874752:12345-0@lo:400:kworker.0 Request processed in 50us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582065.657817:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788582065.658039:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020874880:0@lo:400:kworker.0 00000100:00100000:0.0:1788582065.658076:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582065.658257:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020874880 00000100:00100000:3.0:1788582065.658273:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020874880 00000100:00100000:3.0:1788582065.658313:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788582065.658321:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020874880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582065.658357:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020874880:12345-0@lo:400:kworker.0 Request processed in 37us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582065.658363:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1788582065.658485:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788582065.658497:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788582065.658526:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dabdd1880 x1875464020874752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582065.658542:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020874752:0@lo:400:kworker.0 00000100:00100000:0.0:1788582065.658718:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020874880:0@lo:400:kworker.0 00010000:00010000:1.0:1788582065.901420:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582066.926640:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582067.181634:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabc0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020875008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788582067.181722:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582067.182072:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020875008 00000100:00100000:1.0:1788582067.182082:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020875008 00000100:00100000:1.0:1788582067.182156:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788582067.182167:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020875008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788582067.182375:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788582067.182437:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020875008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 271us (714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582067.182461:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788582067.182915:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dabc0b100 x1875464020875008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788582067.182934:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabc0b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020875008:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788582067.187562:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788582067.950283:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788582068.572680:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582068.572728:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582068.572869:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001968896 00000100:00100000:0.0:1788582068.572879:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001968896 00000100:00100000:0.0:1788582068.572955:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 273 00000100:00100000:0.0:1788582068.572966:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2351:x1875464001968896:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582068.573328:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3332850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2351:x1875464001968896:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 363us (659us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582068.573337:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 273 00000100:00100000:3.0:1788582068.576288:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582068.576333:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582068.576471:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001969024 00000100:00100000:0.0:1788582068.576482:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001969024 00000100:00100000:0.0:1788582068.576558:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001969280 00000100:00100000:0.0:1788582068.576563:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001969280 00000100:00100000:0.0:1788582068.576658:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 98 00000100:00100000:0.0:1788582068.576668:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+5:2351:x1875464001969024:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582068.576755:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+5:2351:x1875464001969024:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 88us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582068.576763:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 98 00000100:00100000:0.0:1788582068.576782:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 99 00000100:00080000:3.0:1788582068.577458:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788582068.577494:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2351:x1875464001969280:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582068.577535:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2351:x1875464001969280:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 747us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582068.577542:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 99 00000100:00100000:1.0:1788582068.584574:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001969152 00000100:00100000:1.0:1788582068.584593:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001969152 00000100:00100000:1.0:1788582068.584707:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 47 00000100:00100000:1.0:1788582068.584721:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+5:2351:x1875464001969152:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582068.584840:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+5:2351:x1875464001969152:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 122us (12109us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582068.584848:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 47 00000100:00080000:3.0:1788582068.586671:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788582068.974003:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582069.997871:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582070.767667:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788582070.767708:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab98c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020875136:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788582070.767789:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582070.767991:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020875136 00000100:00100000:0.0:1788582070.768000:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020875136 00000100:00100000:0.0:1788582070.768066:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788582070.768076:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020875136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788582070.768112:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582070.768158:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc59c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020875136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582070.768179:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:2.0:1788582070.768344:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788582070.768385:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab98c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020875136:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788582070.769908:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020875648:0@lo:400:kworker.0 00000100:00100000:3.0:1788582070.769923:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875464020875520:0@lo:400:kworker.0 00000100:00100000:0.0:1788582070.769977:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020875392:0@lo:400:kworker.0 00000100:00100000:1.0:1788582070.770987:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582070.771031:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788582070.771039:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbc58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020875264:0@lo:400:kworker.0 00000100:00100000:1.0:1788582070.771069:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582070.771096:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020875776:0@lo:400:kworker.0 00000100:00100000:1.0:1788582070.771116:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582070.771169:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020875264 00000100:00100000:1.0:1788582070.771177:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020875264 00000100:00100000:1.0:1788582070.771324:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:1.0:1788582070.771334:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020875264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582070.771385:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3331c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020875264:12345-0@lo:400:kworker.0 Request processed in 52us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582070.771392:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1788582070.771590:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020875648 00000100:00100000:2.0:1788582070.771596:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020875648 00000100:00100000:2.0:1788582070.771636:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788582070.771648:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020875776 00000100:00100000:1.0:1788582070.771656:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020875776 00000100:00100000:2.0:1788582070.771658:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020875648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582070.771708:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc0a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020875648:12345-0@lo:400:kworker.0 Request processed in 50us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582070.771714:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1788582070.771731:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788582070.771736:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788582070.772024:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788582070.772033:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020875776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582070.772069:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020875776:12345-0@lo:400:kworker.0 Request processed in 37us (950us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582070.772075:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788582070.772120:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbc58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020875264:0@lo:400:kworker.0 00000100:00100000:1.0:1788582070.772135:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020875776:0@lo:400:kworker.0 00010000:00080000:1.0:1788582070.772147:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbbd90000 x1875464020875648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582070.772157:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020875648:0@lo:400:kworker.0 00000100:00100000:1.0:1788582070.775238:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582070.775451:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020875392 00000100:00100000:2.0:1788582070.775461:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020875392 00000100:00100000:2.0:1788582070.775521:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788582070.775531:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020875392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582070.775605:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020875392:12345-0@lo:400:kworker.0 Request processed in 76us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582070.775612:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788582070.775883:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbc59500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020875392:0@lo:400:kworker.0 00000100:00100000:3.0:1788582070.776765:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582070.777048:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020875520 00000100:00100000:0.0:1788582070.777058:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020875520 00000100:00100000:0.0:1788582070.777124:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788582070.777133:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875464020875520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582070.777224:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875464020875520:12345-0@lo:400:kworker.0 Request processed in 69us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582070.777231:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788582070.777316:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875464020875520:0@lo:400:kworker.0 00000100:00080000:2.0:1788582070.777416:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788582071.021538:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582072.045594:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582072.301506:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788582072.301531:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020875904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788582072.301606:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582072.301877:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020875904 00000100:00100000:1.0:1788582072.301887:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020875904 00000100:00100000:1.0:1788582072.301979:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788582072.301990:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020875904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788582072.302028:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788582072.302074:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020875904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582072.302082:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1788582072.302561:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788582072.302734:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dabc08000 x1875464020875904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788582072.302759:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabc08000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020875904:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1788582072.879510:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788582073.070425:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582073.696305:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582073.696371:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582073.696416:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582073.696467:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582073.696483:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001969536 00000100:00100000:0.0:1788582073.696499:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001969664 00000100:00100000:0.0:1788582073.696505:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001969664 00000100:00100000:1.0:1788582073.696506:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001969536 00000100:00100000:1.0:1788582073.696580:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001969792 00000100:00100000:1.0:1788582073.696585:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001969792 00000100:00100000:0.0:1788582073.696587:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 49 00000100:00100000:0.0:1788582073.696598:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+5:2352:x1875464001969664:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582073.696608:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 103 00000100:00100000:1.0:1788582073.696613:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+5:2352:x1875464001969536:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582073.696711:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001969408 00000100:00100000:3.0:1788582073.696716:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001969408 00000100:00100000:3.0:1788582073.696749:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 275 00000100:00100000:3.0:1788582073.696757:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3330c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2352:x1875464001969408:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582073.696828:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+5:2352:x1875464001969664:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 231us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582073.696844:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 49 00000100:00100000:0.0:1788582073.696873:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 104 00000100:00100000:0.0:1788582073.696881:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2352:x1875464001969792:12345-192.168.201.12@tcp:400:kworker.0 00000100:00080000:2.0:1788582073.697063:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788582073.697069:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788582073.697178:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+5:2352:x1875464001969536:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 564us (890us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582073.697186:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 103 00000100:00100000:3.0:1788582073.698766:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3330c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2352:x1875464001969408:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 1994us (2333us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582073.698803:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 275 00000100:00100000:0.0:1788582073.699795:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2352:x1875464001969792:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 2905us (3414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582073.699810:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 104 00010000:00010000:3.0:1788582074.093554:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582075.119155:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788582075.887978:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab98ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020876416:0@lo:400:kworker.0 00000100:00100000:3.0:1788582075.888085:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582075.888165:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788582075.888173:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020876032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788582075.888229:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582075.888272:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020876544:0@lo:400:kworker.0 00000100:00100000:3.0:1788582075.888298:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582075.888349:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020876032 00000100:00100000:3.0:1788582075.888358:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020876032 00000100:00100000:3.0:1788582075.888433:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788582075.888445:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020876032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788582075.888492:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788582075.888544:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020876032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582075.888552:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788582075.888578:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020876544 00000100:00100000:3.0:1788582075.888582:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020876544 00000100:00100000:3.0:1788582075.888611:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788582075.888617:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020876544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582075.888649:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020876544:12345-0@lo:400:kworker.0 Request processed in 32us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582075.888655:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1788582075.888670:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788582075.888675:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788582075.889402:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab98f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020876160:0@lo:400:kworker.0 00000100:00100000:2.0:1788582075.889452:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582075.889489:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020876672:0@lo:400:kworker.0 00000100:00100000:2.0:1788582075.889514:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582075.889547:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020876416 00000100:00100000:2.0:1788582075.889552:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020876416 00000100:00100000:2.0:1788582075.889587:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020876672 00000100:00100000:2.0:1788582075.889589:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020876672 00000100:00100000:2.0:1788582075.889605:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788582075.889611:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020876416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582075.889645:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020876416:12345-0@lo:400:kworker.0 Request processed in 34us (1571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582075.889662:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788582075.889678:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788582075.889683:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020876672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582075.889729:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020876672:12345-0@lo:400:kworker.0 Request processed in 45us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582075.889735:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788582075.889773:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020876672:0@lo:400:kworker.0 00000100:00100000:2.0:1788582075.890122:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2dc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020876032:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1788582075.890135:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0d85b37480 x1875464020876544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582075.890146:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020876544:0@lo:400:kworker.0 00000100:00100000:2.0:1788582075.890155:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab98ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020876416:0@lo:400:kworker.0 00000100:00080000:2.0:1788582075.890180:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788582075.890270:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020876160 00000100:00100000:1.0:1788582075.890275:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020876160 00000100:00100000:1.0:1788582075.890307:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788582075.890314:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3331050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020876160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582075.890362:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3331050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020876160:12345-0@lo:400:kworker.0 Request processed in 48us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582075.890368:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:1.0:1788582075.890400:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab98f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020876160:0@lo:400:kworker.0 00000100:00100000:3.0:1788582075.890739:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab98f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875464020876288:0@lo:400:kworker.0 00000100:00100000:3.0:1788582075.890772:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582075.890836:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020876800:0@lo:400:kworker.0 00000100:00100000:3.0:1788582075.890857:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582075.891495:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020876800 00000100:00100000:1.0:1788582075.891501:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020876800 00000100:00100000:1.0:1788582075.891541:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788582075.891549:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020876800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582075.891605:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020876800:12345-0@lo:400:kworker.0 Request processed in 57us (746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582075.891611:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788582075.891907:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020876800:0@lo:400:kworker.0 00000100:00100000:0.0:1788582075.895056:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020876288 00000100:00100000:0.0:1788582075.895084:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020876288 00000100:00100000:0.0:1788582075.895171:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788582075.895182:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875464020876288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582075.895341:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875464020876288:12345-0@lo:400:kworker.0 Request processed in 161us (4567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582075.895350:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788582075.895668:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab98f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875464020876288:0@lo:400:kworker.0 00010000:00010000:1.0:1788582076.149977:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582077.165576:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582077.422128:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788582077.422154:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabc0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020876928:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788582077.422247:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582077.422410:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020876928 00000100:00100000:3.0:1788582077.422419:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020876928 00000100:00100000:3.0:1788582077.422490:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788582077.422501:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020876928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788582077.422540:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788582077.422591:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b34a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020876928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582077.422599:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1788582077.422639:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dabc0ad80 x1875464020876928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582093 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788582077.422657:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabc0ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020876928:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788582077.422903:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788582078.189612:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788582078.813645:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582078.813704:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582078.813804:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001970048 00000100:00100000:2.0:1788582078.813814:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001970048 00000100:00100000:2.0:1788582078.813892:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 108 00000100:00100000:2.0:1788582078.813903:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+5:2351:x1875464001970048:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788582078.813978:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+5:2351:x1875464001970048:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 77us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582078.813986:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 108 00000100:00100000:0.0:1788582078.814414:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001969920 00000100:00100000:0.0:1788582078.814420:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001969920 00000100:00100000:0.0:1788582078.814459:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 277 00000100:00100000:0.0:1788582078.814467:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2351:x1875464001969920:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582078.814507:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3333850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2351:x1875464001969920:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 40us (872us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582078.814514:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 277 00000100:00080000:1.0:1788582078.814852:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788582078.824198:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582078.824309:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582078.824452:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001970176 00000100:00100000:2.0:1788582078.824463:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001970176 00000100:00100000:2.0:1788582078.824544:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 19 00000100:00100000:2.0:1788582078.824554:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+5:2348:x1875464001970176:12345-192.168.201.12@tcp:9:kworker.0 00000100:00100000:0.0:1788582078.824556:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001970304 00000100:00100000:0.0:1788582078.824569:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001970304 00000020:00000080:2.0:1788582078.824605:0:6692:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6d4b 00000100:00100000:0.0:1788582078.824613:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 109 00000100:00080000:2.0:1788582078.824614:0:6692:0:(import.c:65:import_set_state_nolock()) ffff8d0da7009000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788582078.824620:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2352:x1875464001970304:12345-192.168.201.12@tcp:400:kworker.0 00000001:00000004:2.0:1788582078.824651:0:6692:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1788582078.824685:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d11f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2352:x1875464001970304:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 65us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582078.824691:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 109 00010000:00010000:1.0:1788582078.824909:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788582078.824924:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788582078.824928:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788582078.830369:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+2:2348:x1875464001970176:12345-192.168.201.12@tcp:9:kworker.0 Request processed in 5673us (6039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582078.830385:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 19 00010000:00010000:3.0:1788582079.213503:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582080.238441:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788582080.552368:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b99087a3-3c83-4416-b2b9-d522b9885111 00000020:00000080:2.0:1788582080.552376:0:7648:0:(genops.c:885:class_export_put()) final put ffff8d0da700e800/b99087a3-3c83-4416-b2b9-d522b9885111 00000020:00000080:0.0:1788582080.552443:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0da700e800/b99087a3-3c83-4416-b2b9-d522b9885111 for lustre-OST0001 00000020:00000080:0.0:1788582080.552493:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d0da7009000 for lustre-OST0001 00000100:00100000:0.0:1788582081.005489:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020877440:0@lo:400:kworker.0 00000100:00100000:0.0:1788582081.005594:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582081.005655:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788582081.005662:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020877056:0@lo:400:kworker.0 00000100:00100000:0.0:1788582081.005690:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582081.005713:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020877568:0@lo:400:kworker.0 00000100:00100000:0.0:1788582081.005737:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582081.005768:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020877056 00000100:00100000:0.0:1788582081.005774:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020877056 00000100:00100000:3.0:1788582081.005901:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875464020877312:0@lo:400:kworker.0 00000100:00100000:3.0:1788582081.005929:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582081.005965:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788582081.005972:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875464020877184:0@lo:400:kworker.0 00000100:00100000:3.0:1788582081.006004:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582081.006021:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020877696:0@lo:400:kworker.0 00000100:00100000:3.0:1788582081.006041:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582081.006066:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020877568 00000100:00100000:3.0:1788582081.006070:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020877568 00000100:00100000:3.0:1788582081.006112:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020877312 00000100:00100000:3.0:1788582081.006115:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020877312 00000100:00100000:3.0:1788582081.006133:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020877184 00000100:00100000:3.0:1788582081.006136:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020877184 00000100:00100000:3.0:1788582081.006151:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788582081.006160:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020877568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582081.006239:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020877568:12345-0@lo:400:kworker.0 Request processed in 70us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582081.006246:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788582081.006264:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788582081.006270:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875464020877312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582081.006300:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875464020877312:12345-0@lo:400:kworker.0 Request processed in 30us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582081.006305:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1788582081.006316:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788582081.006322:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875464020877184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582081.006347:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875464020877184:12345-0@lo:400:kworker.0 Request processed in 25us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582081.006352:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788582081.006373:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020877440 00000100:00100000:3.0:1788582081.006383:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020877440 00000100:00100000:3.0:1788582081.006407:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020877696 00000100:00100000:3.0:1788582081.006410:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020877696 00000100:00100000:3.0:1788582081.006428:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788582081.006434:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020877440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582081.006463:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020877440:12345-0@lo:400:kworker.0 Request processed in 29us (869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582081.006468:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788582081.006479:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788582081.006484:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020877696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582081.006507:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020877696:12345-0@lo:400:kworker.0 Request processed in 23us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582081.006512:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788582081.006556:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875464020877184:0@lo:400:kworker.0 00000100:00100000:3.0:1788582081.006567:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020877696:0@lo:400:kworker.0 00000100:00100000:3.0:1788582081.006576:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875464020877312:0@lo:400:kworker.0 00000100:00100000:3.0:1788582081.006606:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020877568:0@lo:400:kworker.0 00010000:00080000:3.0:1788582081.006618:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0d85b37800 x1875464020877440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788582081.006629:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020877440:0@lo:400:kworker.0 00000100:00100000:0.0:1788582081.006772:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788582081.006781:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3331450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3306:x1875464020877056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582081.006897:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3331450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3306:x1875464020877056:12345-0@lo:400:kworker.0 Request processed in 118us (1206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582081.006904:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00100000:0.0:1788582081.006943:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020877056:0@lo:400:kworker.0 00000100:00080000:1.0:1788582081.007268:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788582081.007273:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788582081.007275:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788582081.010865:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020877824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788582081.010962:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582081.012002:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020877824 00000100:00100000:1.0:1788582081.012014:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020877824 00000100:00100000:1.0:1788582081.012069:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788582081.012078:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020877824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788582081.012113:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788582081.018133:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020877824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6046us (7161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582081.018148:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788582081.019120:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020877824:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788582081.261439:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788582082.095451:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788582082.296994:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788582082.553345:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabc79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020877952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788582082.553415:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582082.553489:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020877952 00000100:00100000:3.0:1788582082.553498:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020877952 00000100:00100000:3.0:1788582082.553539:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788582082.553548:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020877952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788582082.553582:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788582082.553642:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc7ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020877952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582082.553649:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:3.0:1788582082.553688:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dabc79180 x1875464020877952/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582098 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788582082.553706:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabc79180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020877952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788582082.853366:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582082.853407:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582082.853441:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582082.853602:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001970688 00000100:00100000:1.0:1788582082.853612:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001970688 00000100:00100000:1.0:1788582082.853685:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001970560 00000100:00100000:1.0:1788582082.853688:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001970560 00000100:00100000:1.0:1788582082.853710:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 113 00000100:00100000:1.0:1788582082.853720:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2350:x1875464001970688:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582082.853798:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2350:x1875464001970688:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 79us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582082.853806:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 113 00000100:00100000:1.0:1788582082.853822:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 114 00000100:00100000:1.0:1788582082.853829:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+5:2350:x1875464001970560:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582082.853855:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+5:2350:x1875464001970560:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 27us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582082.853878:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 114 00000100:00100000:2.0:1788582082.854267:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001970432 00000100:00100000:2.0:1788582082.854273:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001970432 00000100:00100000:2.0:1788582082.854314:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 279 00000100:00100000:2.0:1788582082.854322:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2350:x1875464001970432:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788582082.854360:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3330450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2350:x1875464001970432:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 40us (1006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582082.854367:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 279 00000100:00080000:3.0:1788582082.854635:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788582083.310816:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582083.872614:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582083.872651:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582083.872683:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582083.872713:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001971072 00000100:00100000:1.0:1788582083.872721:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001971072 00000100:00100000:1.0:1788582083.872767:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001970944 00000100:00100000:1.0:1788582083.872770:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001970944 00000100:00100000:1.0:1788582083.872789:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 115 00000100:00100000:1.0:1788582083.872798:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2352:x1875464001971072:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582083.872881:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2352:x1875464001971072:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 84us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582083.872889:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 115 00000100:00100000:1.0:1788582083.872906:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 116 00000100:00100000:1.0:1788582083.872912:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+5:2352:x1875464001970944:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582083.872937:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+5:2352:x1875464001970944:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 25us (253us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582083.872944:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 116 00000100:00100000:3.0:1788582083.874543:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001970816 00000100:00100000:3.0:1788582083.874556:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001970816 00000100:00100000:3.0:1788582083.874634:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 280 00000100:00100000:3.0:1788582083.874643:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2352:x1875464001970816:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582083.874942:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3332050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2352:x1875464001970816:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 299us (2335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582083.874951:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 280 00000001:02000400:2.0:1788582083.900092:0:11849:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 00:21:22 (1788582082) 00010000:00010000:1.0:1788582084.336310:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582085.357830:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582085.697868:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582085.697998:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001971200 00000100:00100000:3.0:1788582085.698008:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001971200 00000100:00100000:3.0:1788582085.698091:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 32 00000100:00100000:3.0:1788582085.698103:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+5:10213:x1875464001971200:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788582085.698124:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1788582085.699289:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788582085.699891:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a6e16 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c90df expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582085.699975:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6e1d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582085.699989:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6e1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582085.700003:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6e1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582085.700041:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788582085.700044:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788582085.700083:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6e1d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582085.700113:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a6e16 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90df expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582085.700134:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6e1d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90df expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582085.700142:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d917bd300) 00010000:00010000:3.0:1788582085.700145:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788582085.700173:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26c00, rc 0) 00000100:00100000:3.0:1788582085.700295:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+6:10213:x1875464001971200:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 2191us (2434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582085.700305:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 32 00000100:00100000:2.0:1788582085.713032:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582085.713130:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001971328 00000100:00100000:1.0:1788582085.713140:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001971328 00000100:00100000:1.0:1788582085.713231:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 33 00000100:00100000:1.0:1788582085.713242:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:10214:x1875464001971328:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788582085.713276:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582085.713294:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6e24 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c90e6 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713366:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6e2b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713381:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6e2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713391:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6e2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713405:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6e32 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713412:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6e32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713418:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6e32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713626:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc400/0x2bc3aa892c3a6e39 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713634:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc400/0x2bc3aa892c3a6e39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713642:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc400/0x2bc3aa892c3a6e39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582085.713668:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788582085.713675:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788582085.713698:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc400/0x2bc3aa892c3a6e39 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713708:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6e2b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713715:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6e2b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713722:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6e2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713728:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582085.713732:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6e2b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713739:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6e2b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713750:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d917bd300) 00010000:00010000:1.0:1788582085.713753:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582085.713757:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6e2b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713762:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6e2b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713773:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6e32 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713779:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6e32 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713793:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6e32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713798:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fdc00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582085.713801:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6e32 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713807:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6e32 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713814:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d0da2fafe00) 00010000:00010000:1.0:1788582085.713816:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582085.713818:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6e32 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713823:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6e32 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713849:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6e24 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90e6 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713861:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc400/0x2bc3aa892c3a6e39 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90e6 expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582085.713867:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d0da2faf900) 00010000:00010000:1.0:1788582085.713869:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788582085.713872:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fc400, rc 0) 00000100:00100000:1.0:1788582085.713940:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+7:10214:x1875464001971328:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 700us (917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582085.713955:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 33 00000100:00100000:1.0:1788582085.716928:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582085.723164:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001971584 00000100:00100000:0.0:1788582085.723300:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001971584 00000100:00100000:0.0:1788582085.723388:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 34 00000100:00100000:0.0:1788582085.723400:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+7:10214:x1875464001971584:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788582085.723422:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582085.723445:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6e40 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c90ed expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.723523:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6e47 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.723538:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6e47 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.723550:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6e47 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.723603:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6e4e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.723611:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6e4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.723617:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6e4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.723955:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088c00/0x2bc3aa892c3a6e55 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.723965:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088c00/0x2bc3aa892c3a6e55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.723972:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088c00/0x2bc3aa892c3a6e55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582085.725179:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1788582085.725440:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6e47 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.725449:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6e47 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.725457:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6e47 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.725463:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582085.725467:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6e47 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.725475:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6e47 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.725489:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d0da2faf900) 00010000:00010000:0.0:1788582085.725493:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582085.725497:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6e47 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.725503:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6e47 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.725516:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6e4e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.725522:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6e4e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.725544:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6e4e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.725549:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582085.725553:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6e4e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.725559:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6e4e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.725568:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d0d888dea00) 00010000:00010000:0.0:1788582085.725571:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582085.725574:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6e4e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.725580:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6e4e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.727865:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6e40 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90ed expref: 10 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.727890:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088c00/0x2bc3aa892c3a6e55 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90ed expref: 9 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582085.727898:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d0d888de500) 00010000:00010000:0.0:1788582085.727900:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582085.727903:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7088c00, rc 0) 00000100:00100000:0.0:1788582085.727970:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+9:10214:x1875464001971584:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 4571us (11053us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788582085.728691:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 34 00000100:00100000:2.0:1788582085.738118:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582085.738326:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001971712 00000100:00100000:1.0:1788582085.738337:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001971712 00000100:00100000:1.0:1788582085.738396:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 35 00000100:00100000:1.0:1788582085.738407:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+9:10214:x1875464001971712:12345-192.168.201.12@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788582085.738527:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+9:10214:x1875464001971712:12345-192.168.201.12@tcp:59:lhsmtool_posix.0 Request processed in 121us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582085.738543:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 35 00000100:00100000:0.0:1788582086.125592:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020878080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788582086.125680:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582086.125900:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020878080 00000100:00100000:3.0:1788582086.125910:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020878080 00000100:00100000:3.0:1788582086.126002:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788582086.126013:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020878080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788582086.126050:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788582086.126102:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020878080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582086.126110:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788582086.126168:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020878080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788582086.126672:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020878208:0@lo:400:kworker.0 00000100:00100000:2.0:1788582086.126724:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582086.126754:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020878720:0@lo:400:kworker.0 00000100:00100000:2.0:1788582086.126782:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582086.126803:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788582086.126809:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020878336:0@lo:400:kworker.0 00000100:00100000:2.0:1788582086.126849:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582086.126880:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020878208 00000100:00100000:2.0:1788582086.126885:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020878208 00000100:00100000:2.0:1788582086.126916:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788582086.126923:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020878208:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788582086.127322:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788582086.127816:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3330050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020878208:12345-0@lo:400:kworker.0 Request processed in 49us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582086.127830:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788582086.127876:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020878720 00000100:00100000:2.0:1788582086.127882:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020878720 00000100:00100000:2.0:1788582086.130077:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020878336 00000100:00100000:2.0:1788582086.130088:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020878336 00000100:00080000:0.0:1788582086.131648:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788582086.139586:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788582086.139610:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020878720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582086.139716:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020878720:12345-0@lo:400:kworker.0 Request processed in 115us (12933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582086.139724:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1788582086.139748:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788582086.139755:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020878336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582086.139784:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020878336:12345-0@lo:400:kworker.0 Request processed in 30us (12935us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582086.139789:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788582086.141451:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020878464:0@lo:400:kworker.0 00000100:00100000:1.0:1788582086.141517:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582086.141560:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788582086.141569:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020878592:0@lo:400:kworker.0 00000100:00100000:1.0:1788582086.141594:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582086.141650:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020878464 00000100:00100000:1.0:1788582086.141659:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020878464 00000100:00100000:1.0:1788582086.141727:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788582086.141735:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020878464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582086.141784:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020878464:12345-0@lo:400:kworker.0 Request processed in 50us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582086.141790:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:1.0:1788582086.141811:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788582086.141840:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2df480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020878464:0@lo:400:kworker.0 00000100:00100000:3.0:1788582086.144486:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020878592 00000100:00100000:3.0:1788582086.144499:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020878592 00000100:00100000:3.0:1788582086.144568:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788582086.144585:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020878592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582086.144681:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020878592:12345-0@lo:400:kworker.0 Request processed in 97us (3085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582086.144698:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1788582086.144746:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbf2de300 x1875464020878592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788582102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788582086.144761:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020878592:0@lo:400:kworker.0 00000100:00080000:1.0:1788582086.144957:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788582086.145767:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2ddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020878336:0@lo:400:kworker.0 00000100:00100000:3.0:1788582086.145782:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020878208:0@lo:400:kworker.0 00000100:00100000:3.0:1788582086.145793:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020878720:0@lo:400:kworker.0 00000040:00080000:2.0:1788582086.194297:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788582086.381424:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582087.422149:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582087.665746:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020878848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788582087.665829:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582087.666029:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020878848 00000100:00100000:0.0:1788582087.666038:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020878848 00000100:00100000:0.0:1788582087.666090:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788582087.666100:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020878848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788582087.666143:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582087.666194:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020878848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582087.666225:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:0.0:1788582087.666265:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0d85b35500 x1875464020878848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582103 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788582087.666284:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b35500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020878848:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788582087.779537:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582087.779608:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001971840 00000100:00100000:3.0:1788582087.779619:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001971840 00000100:00100000:3.0:1788582087.779699:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 36 00000100:00100000:3.0:1788582087.779709:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+9:10256:x1875464001971840:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:3.0:1788582087.779733:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582087.779756:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a6e63 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c90f4 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.779823:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a6e6a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.779838:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a6e6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.779849:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a6e6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.779882:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a6e71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.779889:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a6e71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.779896:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a6e71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.780136:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a6e6a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.780145:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a6e6a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.780152:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a6e6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.780158:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582087.780163:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a6e6a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.780171:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a6e6a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.780183:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d917bd300) 00010000:00010000:3.0:1788582087.780186:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582087.780190:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a6e6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.780197:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a6e6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.780242:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a6e71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.780249:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a6e71 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.780255:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a6e71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.780260:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582087.780263:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a6e71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.780269:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a6e71 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.780278:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d0d917bd200) 00010000:00010000:3.0:1788582087.780280:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582087.780283:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a6e71 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.780289:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a6e71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.780321:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a6e63 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90f4 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.780331:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d917bd300) 00010000:00010000:3.0:1788582087.780334:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582087.780344:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a6e63 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90f4 expref: 10 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.780353:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26200, rc 0) 00000100:00100000:3.0:1788582087.780411:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+9:10256:x1875464001971840:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 702us (884us total) trans 0 rc 301/301 00000100:00100000:3.0:1788582087.780418:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 36 00000100:00080000:2.0:1788582087.780814:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788582087.785412:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582087.785519:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001972096 00000100:00100000:1.0:1788582087.785530:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001972096 00000100:00100000:1.0:1788582087.785591:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 37 00000100:00100000:1.0:1788582087.785604:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+9:10256:x1875464001972096:12345-192.168.201.12@tcp:36:lfs.0 00010000:00010000:1.0:1788582087.785666:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582087.785695:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6e1d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90df expref: 9 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582087.785713:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d917bd300) 00010000:00010000:1.0:1788582087.785725:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788582087.786251:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6e78 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582087.786267:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6e78 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582087.786277:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6e78 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582087.786292:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6e7f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582087.786300:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6e7f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582087.786307:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6e7f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582087.788069:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788582087.788086:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6e78 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582087.788106:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6e78 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582087.788124:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6e78 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582087.788131:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fda00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582087.788136:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6e78 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582087.788144:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6e78 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582087.788158:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0da2faf400) 00010000:00010000:1.0:1788582087.788161:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582087.788165:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6e78 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582087.788171:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6e78 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788582087.788189:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004a46aa5c reply state 00000000bc89e41a transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6e7f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582087.788199:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788582087.788346:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+10:10256:x1875464001972096:12345-192.168.201.12@tcp:36:lfs.0 Request processed in 2741us (2940us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788582087.788354:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 37 00010000:00010000:3.0:1788582087.801019:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6e7f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.801038:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6e7f lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.801046:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6e7f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.801052:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fdc00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582087.801057:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6e7f lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.801065:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6e7f lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.801083:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d0da2faf800) 00010000:00010000:3.0:1788582087.801087:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582087.801091:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6e7f lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582087.801098:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6e7f lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582087.911748:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582087.912078:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001972224 00000100:00100000:2.0:1788582087.912088:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001972224 00000100:00100000:2.0:1788582087.912183:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 38 00000100:00100000:2.0:1788582087.912195:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+9:10263:x1875464001972224:12345-192.168.201.12@tcp:101:lctl.0 00010000:00010000:2.0:1788582087.912247:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582087.912272:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a6e86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c90fb expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.912337:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a6e8d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.912367:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a6e8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.912379:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a6e8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582087.912414:0:10136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788582087.912417:0:10136:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788582087.912454:0:10136:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a6e8d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.912479:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a6e86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90fb expref: 11 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.912495:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a6e8d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90fb expref: 10 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.912773:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d85afcc00) 00010000:00010000:2.0:1788582087.912777:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788582087.912780:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05e00, rc 0) 00000100:00100000:2.0:1788582087.913518:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+10:10263:x1875464001972224:12345-192.168.201.12@tcp:101:lctl.0 Request processed in 1319us (1772us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582087.913528:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 38 00000100:00100000:2.0:1788582087.990882:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582087.991004:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001972352 00000100:00100000:3.0:1788582087.991015:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001972352 00000100:00100000:3.0:1788582087.991075:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 39 00000100:00100000:3.0:1788582087.991086:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+10:10270:x1875464001972352:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:3.0:1788582087.991109:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582087.991143:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a6e94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9102 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.991593:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a6e9b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.991611:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a6e9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.991646:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a6e9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.991663:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a6ea2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.991670:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a6ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.991678:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a6ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.991778:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05a00/0x2bc3aa892c3a6ea9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.991787:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05a00/0x2bc3aa892c3a6ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.991794:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05a00/0x2bc3aa892c3a6ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582087.991826:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788582087.991830:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788582087.991868:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05a00/0x2bc3aa892c3a6ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.991881:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a6e9b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.991888:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a6e9b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.991905:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a6e9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.991911:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04a00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582087.991915:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a6e9b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.991923:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a6e9b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.991936:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d85afcc00) 00010000:00010000:2.0:1788582087.991939:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582087.992003:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a6e9b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.992012:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a6e9b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.992029:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a6ea2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.992035:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a6ea2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.992040:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a6ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.992045:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04600 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582087.992049:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a6ea2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.992064:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a6ea2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.992073:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff8d0d85afc000) 00010000:00010000:2.0:1788582087.992076:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582087.992079:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a6ea2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.992085:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a6ea2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.992129:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a6e94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9102 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.992145:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05a00/0x2bc3aa892c3a6ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9102 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582087.992152:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:2.0:1788582087.992154:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788582087.992157:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05a00, rc 0) 00000100:00100000:2.0:1788582087.992314:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+11:10270:x1875464001972352:12345-192.168.201.12@tcp:101:bash.0 Request processed in 1228us (1444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582087.992323:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 39 00000100:00100000:0.0:1788582088.011420:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582088.011730:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001972608 00000100:00100000:1.0:1788582088.011742:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001972608 00000100:00100000:1.0:1788582088.011828:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 40 00000100:00100000:1.0:1788582088.011839:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+11:10270:x1875464001972608:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:1.0:1788582088.011862:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582088.011881:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a6eb0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9109 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.012028:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a6eb7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.012042:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a6eb7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.012055:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a6eb7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.012108:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6ebe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.012148:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6ebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.012155:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6ebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788582088.013335:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788582088.014887:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a6ec5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.015133:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a6ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.015149:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a6ec5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.015256:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a6eb7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.015264:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a6eb7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.015271:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a6eb7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.015277:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fc200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582088.015282:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a6eb7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.015289:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a6eb7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.015303:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:1.0:1788582088.015307:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582088.015311:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a6eb7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.015317:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a6eb7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788582088.015333:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006751db27 reply state 0000000087d0c99e transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6ebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582088.015341:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788582088.015384:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a6eb0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9109 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.015412:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a6ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9109 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.015420:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0da2faf600) 00010000:00010000:1.0:1788582088.015423:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788582088.015425:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fd800, rc 0) 00000100:00100000:1.0:1788582088.017728:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+14:10270:x1875464001972608:12345-192.168.201.12@tcp:101:bash.0 Request processed in 5879us (6307us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1788582088.017739:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 40 00000100:00100000:1.0:1788582088.023564:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00010000:00010000:3.0:1788582088.024196:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6ebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.024237:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6ebe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.024244:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6ebe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.024250:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582088.024254:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6ebe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.024262:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6ebe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.024278:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d0da2faf400) 00010000:00010000:3.0:1788582088.024281:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582088.024285:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6ebe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.024309:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6ebe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582088.024725:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001972736 00000100:00100000:2.0:1788582088.024736:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001972736 00000100:00100000:2.0:1788582088.024786:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 20 00000100:00100000:2.0:1788582088.024795:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875464001972736:12345-192.168.201.12@tcp:8:bash.0 00010000:00080000:2.0:1788582088.024824:0:6692:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp t0 exp 0000000000000000 cur 307 last 0 00000020:00000080:2.0:1788582088.024858:0:6692:0:(genops.c:1385:class_connect()) connect: client b99087a3-3c83-4416-b2b9-d522b9885111, cookie 0x2bc3aa892c3a6ed3 00002000:00100000:2.0:1788582088.024869:0:6692:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b99087a3-3c83-4416-b2b9-d522b9885111/ffff8d0da98aa000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788582088.024880:0:6692:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788582088.025263:0:6692:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788582088.025297:0:6692:0:(import.c:65:import_set_state_nolock()) ffff8d0da98ac800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788582088.025375:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+6:2348:x1875464001972736:12345-192.168.201.12@tcp:8:bash.0 Request processed in 579us (1822us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582088.025384:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 20 00000100:00100000:2.0:1788582088.031421:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582088.031516:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001972864 00000100:00100000:3.0:1788582088.031527:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001972864 00000100:00100000:3.0:1788582088.031605:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 21 00000100:00100000:3.0:1788582088.031616:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:0:x1875464001972864:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:3.0:1788582088.031636:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582088.031662:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089a4c5dd/0x2bc3aa892c3a6eda lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9110 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788582088.031690:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788582088.031707:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=307s v=(0 0) 00010000:00010000:3.0:1788582088.031712:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582088.031721:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089a4c5dd/0x2bc3aa892c3a6eda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9110 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.031741:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000089a4c5dd/0x2bc3aa892c3a6eda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9110 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.031756:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26400, rc 0) 00000100:00100000:3.0:1788582088.031818:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd94000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+7:0:x1875464001972864:12345-192.168.201.12@tcp:101:bash.0 Request processed in 204us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582088.031826:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 21 00000100:00080000:2.0:1788582088.033452:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788582088.036597:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582088.036698:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001972992 00000100:00100000:1.0:1788582088.036710:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001972992 00000100:00100000:1.0:1788582088.036770:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 22 00000100:00100000:1.0:1788582088.036781:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+7:10270:x1875464001972992:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:1.0:1788582088.036800:0:8034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582088.036821:0:8034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a6ee1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9117 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.036853:0:8034:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089a4c5dd/0x2bc3aa892c3a6eda lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9110 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.036862:0:8034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582088.036866:0:8034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582088.036871:0:8034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a6ee1 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9117 expref: 8 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.036937:0:8034:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089a4c5dd/0x2bc3aa892c3a6eda lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9110 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.036952:0:8034:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089a4c5dd/0x2bc3aa892c3a6eda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9110 expref: 8 pid: 6691 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582088.036975:0:8034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8034:1875464020878976:192.168.201.12@tcp:104: 00000100:00100000:1.0:1788582088.037074:0:8034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8a934d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788582088.040327:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582088.040412:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001973120 00000100:00100000:3.0:1788582088.040433:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001973120 00010000:00010000:3.0:1788582088.040473:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089a4c5dd/0x2bc3aa892c3a6eda lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9110 expref: 9 pid: 6691 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582088.040528:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 35 00000100:00100000:3.0:1788582088.040538:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+9:2349:x1875464001973120:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582088.040552:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582088.040574:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089a4c5dd/0x2bc3aa892c3a6eda lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9110 expref: 9 pid: 6691 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.040588:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089a4c5dd/0x2bc3aa892c3a6eda lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9110 expref: 9 pid: 6691 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.040612:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582088.040617:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582088.040625:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a6ee1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9117 expref: 9 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.040634:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a6ee1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9117 expref: 9 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.040679:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a6ee1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9117 expref: 9 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582088.040693:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabc7a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5828:1875464020879104:192.168.201.12@tcp:105: 00000100:00100000:3.0:1788582088.040778:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85b42b40 going to sleep for 11 seconds 00010000:00010000:2.0:1788582088.041027:0:8034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089a4c5dd/0x2bc3aa892c3a6eda lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9110 expref: 9 pid: 6691 timeout: 407 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582088.041045:0:8034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2dce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8034:1875464020878976:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582088.041069:0:8034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a6ee1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9117 expref: 8 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.041078:0:8034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fc200, rc 0) 00000100:00100000:2.0:1788582088.041106:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+8:10270:x1875464001972992:12345-192.168.201.12@tcp:101:bash.0 Request processed in 4327us (4520us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582088.041123:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 22 00000100:00100000:3.0:1788582088.043793:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582088.043973:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabc7a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5828:1875464020879104:192.168.201.12@tcp:105: 00010000:00010000:0.0:1788582088.043991:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788582088.044036:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+7:2349:x1875464001973120:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 3499us (3719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582088.044046:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 35 00000100:00100000:1.0:1788582088.044755:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001973376 00000100:00100000:1.0:1788582088.044764:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001973376 00000100:00100000:1.0:1788582088.044824:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 6 00000100:00100000:1.0:1788582088.044835:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+13:10270:x1875464001973376:12345-192.168.201.12@tcp:35:bash.0 00000100:00100000:1.0:1788582088.045160:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+14:10270:x1875464001973376:12345-192.168.201.12@tcp:35:bash.0 Request processed in 325us (1372us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788582088.045168:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 6 00000100:00100000:1.0:1788582088.127336:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582088.127576:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001973632 00000100:00100000:2.0:1788582088.127587:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001973632 00000100:00100000:2.0:1788582088.127706:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 41 00000100:00100000:2.0:1788582088.127717:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+14:10279:x1875464001973632:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:2.0:1788582088.127761:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582088.127782:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a6ee8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c911e expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582088.127871:0:10136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788582088.127996:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a6ee8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c911e expref: 16 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.128010:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d85afcc00) 00010000:00010000:2.0:1788582088.128013:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788582088.128019:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a6ee8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c911e expref: 16 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.128032:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04a00, rc 0) 00000100:00100000:2.0:1788582088.128095:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+15:10279:x1875464001973632:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 380us (770us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1788582088.128103:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 41 00000100:00100000:3.0:1788582088.130595:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582088.130950:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001973888 00000100:00100000:1.0:1788582088.130961:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001973888 00000100:00100000:1.0:1788582088.131022:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 7 00000100:00100000:1.0:1788582088.131032:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+15:10279:x1875464001973888:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:1.0:1788582088.131304:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+16:10279:x1875464001973888:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 272us (717us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788582088.131312:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 7 00000100:00100000:3.0:1788582088.203495:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582088.203612:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001974016 00000100:00100000:2.0:1788582088.203623:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001974016 00000100:00100000:2.0:1788582088.203696:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 42 00000100:00100000:2.0:1788582088.203708:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+16:10286:x1875464001974016:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:2.0:1788582088.203734:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582088.203755:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a6ef6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9125 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.203821:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a6efd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.203854:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a6efd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.203865:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a6efd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582088.203901:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788582088.203905:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788582088.203921:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a6efd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.203957:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a6ef6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9125 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.203975:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a6efd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9125 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.203984:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:2.0:1788582088.203987:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788582088.203990:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05000, rc 0) 00000100:00100000:2.0:1788582088.204057:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+17:10286:x1875464001974016:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 350us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582088.204064:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 42 00000100:00100000:3.0:1788582088.208595:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582088.208695:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001974272 00000100:00100000:1.0:1788582088.208706:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001974272 00000100:00100000:1.0:1788582088.208766:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 43 00000100:00100000:1.0:1788582088.208777:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+17:10286:x1875464001974272:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:1.0:1788582088.208800:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582088.208823:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a6f04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c912c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.208923:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a6f0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.208936:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a6f0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.208959:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a6f0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582088.208970:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788582088.209100:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a6f04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c912c expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.209130:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a6f0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c912c expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.209140:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0da2faf600) 00010000:00010000:1.0:1788582088.209143:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788582088.209146:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fcc00, rc 0) 00000100:00100000:1.0:1788582088.209398:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+19:10286:x1875464001974272:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 622us (811us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788582088.209422:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 43 00000100:00100000:1.0:1788582088.216545:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582088.216593:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582088.216692:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001974656 00000100:00100000:2.0:1788582088.216703:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001974656 00000100:00100000:2.0:1788582088.216768:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 44 00000100:00100000:2.0:1788582088.216780:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+19:10286:x1875464001974656:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:2.0:1788582088.216808:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582088.216845:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a6f19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9133 expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.216942:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a6f20 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.216957:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a6f20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.216968:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a6f20 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582088.216979:0:10136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788582088.217103:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a6f19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9133 expref: 22 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.217132:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a6f20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9133 expref: 21 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.217141:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0da2faf600) 00010000:00010000:2.0:1788582088.217144:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788582088.217147:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04600, rc 0) 00000100:00100000:2.0:1788582088.217256:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+21:10286:x1875464001974656:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 478us (661us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788582088.217263:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 44 00000100:00100000:3.0:1788582088.217331:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001974400 00000100:00100000:3.0:1788582088.217336:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001974400 00000100:00100000:3.0:1788582088.217380:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 2 00000100:00100000:3.0:1788582088.217387:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+21:2350:x1875464001974400:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582088.217397:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582088.217414:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a6f0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c912c expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.217426:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0da2faf600) 00010000:00010000:3.0:1788582088.217429:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582088.217450:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2df480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+20:2350:x1875464001974400:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 64us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582088.217457:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 2 00000100:00100000:3.0:1788582088.222159:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582088.222370:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001974784 00000100:00100000:0.0:1788582088.222383:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001974784 00000100:00100000:0.0:1788582088.222543:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 23 00000100:00100000:0.0:1788582088.222570:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+7:2349:x1875464001974784:12345-192.168.201.12@tcp:1:lfs.0 00010000:00010000:0.0:1788582088.222621:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c985211f/0x2bc3aa892c3a6f2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.222642:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a6ee1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9117 expref: 7 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.222651:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582088.222656:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788582088.222673:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c985211f/0x2bc3aa892c3a6f2e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.222710:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a6ee1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9117 expref: 7 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.222725:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a6ee1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9117 expref: 7 pid: 8034 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582088.222741:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b35c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1875464020879232:192.168.201.12@tcp:104: 00000100:00100000:0.0:1788582088.222874:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dab9c2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788582088.225303:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582088.225425:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001974912 00000100:00100000:2.0:1788582088.225434:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001974912 00002000:00100000:2.0:1788582088.225542:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8d0d85b37100 x1875464001974912/t0(0) o4->b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp:689/0 lens 504/0 e 0 to 0 dl 1788582099 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788582088.225554:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0d85b37100 with x1875464001974912 ext(0->12) 00010000:00010000:2.0:1788582088.225575:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a6ee1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9117 expref: 8 pid: 8034 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.225592:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a6ee1 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9117 expref: 8 pid: 8034 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788582088.225600:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d0d85b37100 00000100:00100000:2.0:1788582088.225635:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 0 00000100:00100000:2.0:1788582088.225645:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b99087a3-3c83-4416-b2b9-d522b9885111+8:2350:x1875464001974912:12345-192.168.201.12@tcp:4:lfs.0 00000100:00100000:3.0:1788582088.227399:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b35c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6691:1875464020879232:192.168.201.12@tcp:104: 00010000:00010000:3.0:1788582088.227428:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000c985211f/0x2bc3aa892c3a6f2e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:3.0:1788582088.254074:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b99087a3-3c83-4416-b2b9-d522b9885111 00000001:00080000:2.0:1788582088.281024:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1788582088.281276:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b99087a3-3c83-4416-b2b9-d522b9885111+7:2350:x1875464001974912:12345-192.168.201.12@tcp:4:lfs.0 Request processed in 55627us (55976us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788582088.281293:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 0 00002000:00100000:3.0:1788582088.281315:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff8d0d85b37100 x1875464001974912/t4294967299(0) o4->b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp:689/0 lens 504/448 e 0 to 0 dl 1788582099 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788582088.281325:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0d85b37100 with x1875464001974912 ext(0->12) 00010000:00010000:3.0:1788582088.281336:0:6696:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a6ee1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9117 expref: 7 pid: 8034 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.281354:0:6696:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a6ee1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9117 expref: 7 pid: 8034 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788582088.281362:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d0d85b37100 00000100:00100000:1.0:1788582088.285063:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582088.285281:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001975040 00000100:00100000:0.0:1788582088.285292:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001975040 00010000:00010000:0.0:1788582088.285341:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a6ee1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9117 expref: 7 pid: 8034 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582088.285426:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 36 00000100:00100000:0.0:1788582088.285449:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+7:2349:x1875464001975040:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788582088.285478:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788582088.285508:0:7636:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788582088.285512:0:7636:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788582087 00002000:00010000:0.0:1788582088.285515:0:7636:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788582087 00002000:00010000:0.0:1788582088.285517:0:7636:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788582087 00002000:00010000:0.0:1788582088.285519:0:7636:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1788582088.285524:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a6ee1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9117 expref: 7 pid: 8034 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.285541:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a6ee1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9117 expref: 7 pid: 8034 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.285567:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a6ee1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9117 expref: 7 pid: 8034 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.285585:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788582088.285590:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788582088.285596:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c985211f/0x2bc3aa892c3a6f2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.285605:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c985211f/0x2bc3aa892c3a6f2e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.285641:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788582088.285711:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc59500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+6:2349:x1875464001975040:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 263us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582088.285727:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 36 00010000:00010000:1.0:1788582088.285915:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000c985211f/0x2bc3aa892c3a6f2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.285924:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c985211f/0x2bc3aa892c3a6f2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.285948:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c985211f/0x2bc3aa892c3a6f2e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.285957:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c985211f/0x2bc3aa892c3a6f2e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.285965:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c985211f/0x2bc3aa892c3a6f2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.285972:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088200 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582088.285976:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c985211f/0x2bc3aa892c3a6f2e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.285985:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c985211f/0x2bc3aa892c3a6f2e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.286011:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c985211f/0x2bc3aa892c3a6f2e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.286019:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c985211f/0x2bc3aa892c3a6f2e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582088.286082:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+5:2349:x1875464001974784:12345-192.168.201.12@tcp:1:lfs.0 Request processed in 63514us (63930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582088.286090:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 23 00000100:00100000:1.0:1788582088.289092:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582088.289185:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001975296 00000100:00100000:0.0:1788582088.289196:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001975296 00000100:00100000:0.0:1788582088.289381:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 8 00000100:00100000:0.0:1788582088.289391:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+20:10286:x1875464001975296:12345-192.168.201.12@tcp:35:lfs.0 00000004:00010000:0.0:1788582088.289569:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a6f20 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9133 expref: 20 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788582088.290011:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1788582088.290069:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788582088.290987:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1788582088.291053:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f35 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.291070:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a6ec5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9109 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.291079:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f35 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.291130:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a6ec5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9109 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.291146:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a6ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9109 expref: 24 pid: 5844 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582088.291161:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b36680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1875464020879360:192.168.201.12@tcp:104: 00000100:00100000:0.0:1788582088.291401:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dab9c2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788582088.294742:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582088.294823:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001975424 00000100:00100000:1.0:1788582088.294833:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001975424 00010000:00010000:1.0:1788582088.294874:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a6ec5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9109 expref: 25 pid: 5844 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582088.294913:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 37 00000100:00100000:1.0:1788582088.294923:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+25:2350:x1875464001975424:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788582088.294939:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582088.294946:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a6ec5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9109 expref: 25 pid: 5844 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.294960:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a6ec5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9109 expref: 25 pid: 5844 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.294984:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0da2faf600) 00010000:00010000:1.0:1788582088.295005:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f35 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.295014:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.295020:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f35 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.295040:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788582088.295094:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd95f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+25:2350:x1875464001975424:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 171us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582088.295102:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 37 00010000:00010000:0.0:1788582088.296315:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a6ec5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9109 expref: 24 pid: 5844 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582088.296335:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b36680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1875464020879360:192.168.201.12@tcp:104: 00010000:00010000:0.0:1788582088.296359:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.296369:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.296375:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788582088.296637:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1788582088.297044:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1788582088.297888:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1875464020879488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788582088.297991:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582088.298051:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d909e7840 going to sleep for 11 seconds 00000100:00100000:0.0:1788582088.298102:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020879488 00000100:00100000:0.0:1788582088.298119:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020879488 00000100:00100000:0.0:1788582088.298250:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788582088.298260:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1875464020879488:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788582088.298352:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5847:x1875464020879488:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 93us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582088.298360:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788582088.298444:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702df80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1875464020879488:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788582088.299295:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1788582088.299367:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabc7bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1875464020879616:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788582088.299409:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582088.299434:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85b42a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788582088.299528:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020879616 00000100:00100000:1.0:1788582088.299534:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020879616 00000100:00100000:1.0:1788582088.299564:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788582088.299572:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5847:x1875464020879616:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788582088.299811:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5847:x1875464020879616:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 239us (399us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788582088.299819:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788582088.300153:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabc7bb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1875464020879616:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1788582088.300336:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1788582088.300380:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.300391:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f35 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.300400:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f35 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.300406:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582088.300420:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f35 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.300428:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f35 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.300444:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0da2faf600) 00000100:00080000:2.0:1788582088.300572:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788582088.300602:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788582088.300608:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f35 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.300615:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f35 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788582088.300972:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788582088.301195:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788582088.301422:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 307295219285ns, next at 308295216681ns, rc = 0 00000001:00080000:3.0:1788582088.301432:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1788582088.301488:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0da2faf600) 00010000:00010000:3.0:1788582088.301500:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788582088.301508:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a6f20 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9133 expref: 28 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582088.301629:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+27:10286:x1875464001975296:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 12238us (12544us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788582088.301638:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 8 00000020:00080000:3.0:1788582088.301642:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788582088.304393:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582088.304477:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001975552 00000100:00100000:3.0:1788582088.304488:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001975552 00000100:00100000:3.0:1788582088.304551:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 45 00000100:00100000:3.0:1788582088.304561:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+27:10286:x1875464001975552:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:3.0:1788582088.304594:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582088.304618:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a6f3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c913a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.304679:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a6f3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c913a expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.304693:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a6f3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c913a expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.304711:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:3.0:1788582088.304714:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788582088.304718:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26200, rc 0) 00000100:00100000:3.0:1788582088.304779:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+28:10286:x1875464001975552:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 219us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582088.304785:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 45 00000100:00100000:2.0:1788582088.307539:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582088.307850:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001975808 00000100:00100000:3.0:1788582088.307860:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001975808 00000100:00100000:3.0:1788582088.307957:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 9 00000100:00100000:3.0:1788582088.307969:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d84f81450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+28:10286:x1875464001975808:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:3.0:1788582088.308263:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d84f81450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+29:10286:x1875464001975808:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 296us (731us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1788582088.308271:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 9 00000100:00100000:1.0:1788582088.380259:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582088.380351:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001976064 00000100:00100000:3.0:1788582088.380362:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001976064 00000100:00100000:3.0:1788582088.380427:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 46 00000100:00100000:3.0:1788582088.380437:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+29:10296:x1875464001976064:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:3.0:1788582088.380476:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582088.380506:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a6f43 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9141 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582088.380596:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788582088.380744:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a6f43 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9141 expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.380759:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d85afcc00) 00010000:00010000:3.0:1788582088.380762:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788582088.380766:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a6f43 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9141 expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.380781:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27c00, rc 0) 00000100:00100000:3.0:1788582088.380840:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+30:10296:x1875464001976064:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 404us (591us total) trans 4294967327 rc 301/301 00000100:00100000:3.0:1788582088.380848:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 46 00000100:00100000:2.0:1788582088.384920:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582088.385047:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001976192 00000100:00100000:1.0:1788582088.385057:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001976192 00000100:00100000:1.0:1788582088.385124:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 47 00000100:00100000:1.0:1788582088.385134:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+30:10296:x1875464001976192:12345-192.168.201.12@tcp:34:lfs.0 00010000:00010000:1.0:1788582088.385258:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6f51 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385276:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6f51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385287:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6f51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385303:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6f58 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385310:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6f58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385317:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6f58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385402:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6f5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385410:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385418:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788582088.385457:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385470:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6f51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385487:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6f51 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385612:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6f51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385621:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582088.385626:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6f51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385633:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6f51 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385646:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:1.0:1788582088.385649:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582088.385654:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6f51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385720:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a6f51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385734:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6f58 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385739:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6f58 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385745:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6f58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385751:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582088.385760:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6f58 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385766:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6f58 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385774:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d0da2fafa00) 00010000:00010000:1.0:1788582088.385777:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582088.385780:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6f58 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385785:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6f58 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385798:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6f5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385804:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6f5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385809:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6f5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385813:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fda00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582088.385816:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6f5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385821:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6f5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385826:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:1.0:1788582088.385828:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582088.385837:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6f5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.385843:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6f5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582088.386009:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+30:10296:x1875464001976192:12345-192.168.201.12@tcp:34:lfs.0 Request processed in 874us (1097us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582088.386018:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 47 00000100:00100000:0.0:1788582088.389826:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582088.389916:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001976448 00000100:00100000:3.0:1788582088.389926:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001976448 00000100:00100000:3.0:1788582088.390015:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 10 00000100:00100000:3.0:1788582088.390026:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+30:10296:x1875464001976448:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:3.0:1788582088.390303:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+31:10296:x1875464001976448:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 277us (486us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1788582088.390310:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 10 00000100:00100000:2.0:1788582088.424687:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582088.424772:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001976704 00000100:00100000:0.0:1788582088.424781:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001976704 00000100:00100000:0.0:1788582088.424828:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 48 00000100:00100000:0.0:1788582088.424836:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+31:10299:x1875464001976704:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:0.0:1788582088.424857:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582088.424872:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6f66 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9148 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.424963:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6f6d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.424977:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6f6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.424988:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6f6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.425003:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6f74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.425010:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.425017:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.425128:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6f7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.425142:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.425149:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6f7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582088.425159:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788582088.425588:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6f6d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.425595:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6f6d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.425599:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6f6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.425602:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582088.425605:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6f6d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.425618:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6f6d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.425628:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:2.0:1788582088.425630:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582088.425633:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6f6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.425637:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a6f6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.425647:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6f74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.425650:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6f74 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.425654:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6f74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.425657:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582088.425659:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6f74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.425664:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6f74 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.425671:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d0d888dea00) 00010000:00010000:2.0:1788582088.425674:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582088.425677:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6f74 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.425692:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a6f74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.425736:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a6f66 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9148 expref: 34 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.425748:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6f7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9148 expref: 33 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582088.425753:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:2.0:1788582088.425754:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788582088.425756:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7089800, rc 0) 00000100:00100000:2.0:1788582088.425815:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+33:10299:x1875464001976704:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 980us (1142us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788582088.425821:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 48 00000100:00100000:2.0:1788582088.428117:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582088.428192:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001976832 00000100:00100000:3.0:1788582088.428292:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001976832 00000100:00100000:0.0:1788582088.428404:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 49 00000100:00100000:0.0:1788582088.428415:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+33:10299:x1875464001976832:12345-192.168.201.12@tcp:54:lfs.0 00010000:00010000:0.0:1788582088.428489:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.428548:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.428557:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.428580:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.428585:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.428590:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.428593:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582088.428598:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.428602:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.428610:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:0.0:1788582088.428612:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788582088.428614:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.428618:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a6f89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582088.428689:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+33:10299:x1875464001976832:12345-192.168.201.12@tcp:54:lfs.0 Request processed in 275us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582088.428696:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 49 00010000:00010000:3.0:1788582088.429913:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582088.431084:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582088.431153:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001977088 00000100:00100000:3.0:1788582088.431163:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001977088 00000100:00100000:3.0:1788582088.431227:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 11 00000100:00100000:3.0:1788582088.431237:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+33:10299:x1875464001977088:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:3.0:1788582088.431463:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+34:10299:x1875464001977088:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 227us (383us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1788582088.431470:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 11 00000100:00100000:2.0:1788582088.639005:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582088.639129:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001977344 00000100:00100000:1.0:1788582088.639139:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001977344 00000100:00100000:1.0:1788582088.639199:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 50 00000100:00100000:1.0:1788582088.639236:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaefb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+34:10331:x1875464001977344:12345-192.168.201.12@tcp:101:cat.0 00010000:00010000:1.0:1788582088.639261:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582088.639281:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6f90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c914f expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.639381:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6f97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.639394:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6f97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.639404:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6f97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582088.639415:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788582088.639586:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a6f90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c914f expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.639607:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6f97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c914f expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.639629:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:1.0:1788582088.639632:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788582088.639635:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fd000, rc 0) 00000100:00100000:1.0:1788582088.639813:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaefb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+36:10331:x1875464001977344:12345-192.168.201.12@tcp:101:cat.0 Request processed in 578us (818us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788582088.639820:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 50 00000100:00100000:2.0:1788582088.643752:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582088.643924:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001977472 00000100:00100000:3.0:1788582088.643935:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001977472 00000100:00100000:3.0:1788582088.644050:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 3 00000100:00100000:3.0:1788582088.644061:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d86671450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+36:2351:x1875464001977472:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582088.644077:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582088.644115:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a6f97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c914f expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.644134:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:3.0:1788582088.644139:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582088.644198:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d86671450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+35:2351:x1875464001977472:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 138us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582088.644242:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 3 00000100:00100000:0.0:1788582088.651383:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582088.652045:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001977728 00000100:00100000:1.0:1788582088.652057:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001977728 00000100:00100000:1.0:1788582088.652131:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 12 00000100:00100000:1.0:1788582088.652141:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+35:10331:x1875464001977728:12345-192.168.201.12@tcp:35:cat.0 00000100:00100000:1.0:1788582088.652682:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+36:10331:x1875464001977728:12345-192.168.201.12@tcp:35:cat.0 Request processed in 540us (1306us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788582088.652691:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 12 00000100:00100000:2.0:1788582088.699503:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582088.700060:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001977984 00000100:00100000:3.0:1788582088.700071:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001977984 00000100:00100000:3.0:1788582088.700195:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 51 00000100:00100000:3.0:1788582088.700233:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+36:10337:x1875464001977984:12345-192.168.201.12@tcp:101:dd.0 00010000:00010000:3.0:1788582088.700254:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582088.700257:0:10137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788582088.700292:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a6efd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9125 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.700307:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:3.0:1788582088.700311:0:10137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788582088.700321:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a6fa5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9156 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.700402:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6fac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.700412:0:10137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6f7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9148 expref: 36 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.700418:0:10137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6fac lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.700442:0:10137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6f7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9148 expref: 36 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.700451:0:10137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6f7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9148 expref: 36 pid: 10137 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582088.700461:0:10137:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabc7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10137:1875464020879744:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582088.700695:0:10137:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c8381f000 going to sleep for 11 seconds 00000100:00100000:2.0:1788582088.703774:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582088.703949:0:10137:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabc7b480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10137:1875464020879744:192.168.201.12@tcp:104: 00010000:00010000:0.0:1788582088.703974:0:10137:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6fac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582088.704051:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001978112 00000100:00100000:1.0:1788582088.704059:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001978112 00010000:00010000:1.0:1788582088.704095:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6f7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9148 expref: 37 pid: 10137 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582088.704141:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 38 00000100:00100000:1.0:1788582088.704148:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaef8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+37:2349:x1875464001978112:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788582088.704160:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582088.704165:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6f7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9148 expref: 37 pid: 10137 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.704174:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6f7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9148 expref: 37 pid: 10137 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.704231:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a6f7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9148 expref: 37 pid: 10137 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.704242:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:1.0:1788582088.704246:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6fac lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.704253:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6fac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.704258:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6fac lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.704272:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788582088.704313:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaef8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+36:2349:x1875464001978112:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 166us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582088.704318:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 38 00010000:00010000:0.0:1788582088.704616:0:10137:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6fac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.704622:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6fac lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582088.704637:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788582088.704796:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a6fa5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9156 expref: 37 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.704812:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6fac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9156 expref: 36 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.704819:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:0.0:1788582088.704821:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788582088.704824:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26c00, rc 0) 00000100:00100000:0.0:1788582088.704865:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaef9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+36:10337:x1875464001977984:12345-192.168.201.12@tcp:101:dd.0 Request processed in 4661us (5378us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1788582088.704882:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 51 00000100:00100000:2.0:1788582088.708873:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582088.708955:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001978368 00000100:00100000:0.0:1788582088.708966:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001978368 00000100:00100000:0.0:1788582088.709024:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 52 00000100:00100000:0.0:1788582088.709035:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaefb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+36:10337:x1875464001978368:12345-192.168.201.12@tcp:36:dd.0 00010000:00010000:0.0:1788582088.709340:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a6fba lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.709357:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a6fba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.709368:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a6fba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788582088.709421:0:10136:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1788582088.709461:0:10136:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a461723 reply state 00000000ee7c6828 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a6fba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582088.709470:0:10136:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788582088.709571:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaefb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+39:10337:x1875464001978368:12345-192.168.201.12@tcp:36:dd.0 Request processed in 537us (707us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1788582088.709579:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 52 00000020:00080000:0.0:1788582088.709584:0:10136:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788582088.721574:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a6fba lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.721589:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a6fba lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.721608:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a6fba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.721612:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088a00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582088.721616:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a6fba lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.721621:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a6fba lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.721635:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:3.0:1788582088.721637:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582088.721640:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a6fba lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.721644:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a6fba lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582088.923349:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582088.924736:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001978496 00000100:00100000:3.0:1788582088.924749:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001978496 00000100:00100000:3.0:1788582088.924864:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 53 00000100:00100000:3.0:1788582088.924876:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaefbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+38:10351:x1875464001978496:12345-192.168.201.12@tcp:101:stat.0 00010000:00010000:3.0:1788582088.924901:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582088.924923:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a6fc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c915d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.925075:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6fc8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.925090:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6fc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.925115:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6fc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.925132:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a6fcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.925139:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a6fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.925353:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a6fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.925456:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6fd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.925467:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6fac lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9156 expref: 39 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.925475:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6fd6 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.925850:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6fac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9156 expref: 39 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582088.925866:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6fac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9156 expref: 39 pid: 10137 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582088.925880:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabc78380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875464020879872:192.168.201.12@tcp:104: 00000100:00100000:3.0:1788582088.926300:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c8381f900 going to sleep for 11 seconds 00000100:00100000:1.0:1788582088.928847:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582088.928945:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabc78380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875464020879872:192.168.201.12@tcp:104: 00010000:00010000:3.0:1788582088.928971:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6fd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582088.929318:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001978752 00000100:00100000:0.0:1788582088.929325:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001978752 00000100:00100000:0.0:1788582088.929419:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 13 00000100:00100000:0.0:1788582088.929429:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+40:9938:x1875464001978752:12345-192.168.201.12@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788582088.929812:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+41:9938:x1875464001978752:12345-192.168.201.12@tcp:35:ldlm_bl.0 Request processed in 383us (972us total) trans 4294967336 rc 0/0 00000100:00100000:0.0:1788582088.929834:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 13 00000100:00100000:2.0:1788582088.932758:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582088.932865:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001978880 00000100:00100000:0.0:1788582088.932877:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001978880 00010000:00010000:0.0:1788582088.932918:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6fac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9156 expref: 41 pid: 10137 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582088.932993:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 39 00000100:00100000:0.0:1788582088.933004:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaef8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+41:2349:x1875464001978880:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788582088.933020:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582088.933026:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6fac lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9156 expref: 41 pid: 10137 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.933039:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6fac lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9156 expref: 41 pid: 10137 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.933059:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a6fac lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9156 expref: 41 pid: 10137 timeout: 407 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.933074:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:0.0:1788582088.933078:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6fd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.933087:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.933105:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6fd6 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582088.933156:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788582088.933238:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaef8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+40:2349:x1875464001978880:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 235us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582088.933245:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 39 00010000:00010000:1.0:1788582088.935864:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.935880:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582088.935929:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788582088.935934:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788582088.935983:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.935999:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6fd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.936023:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6fc8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.936030:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6fc8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.936036:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6fc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.936042:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582088.936046:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6fc8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.936053:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6fc8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.936067:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:1.0:1788582088.936069:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582088.936074:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6fc8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.936080:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a6fc8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.936110:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a6fcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.936117:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a6fcf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.936123:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a6fcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.936133:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582088.936136:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a6fcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.936143:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a6fcf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.936152:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d0d917bdd00) 00010000:00010000:1.0:1788582088.936154:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582088.936157:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a6fcf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.936163:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a6fcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.936252:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a6fc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c915d expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.936268:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6fd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c915d expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582088.936275:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:1.0:1788582088.936277:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788582088.936280:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27800, rc 0) 00000100:00100000:1.0:1788582088.936345:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaefbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+39:10351:x1875464001978496:12345-192.168.201.12@tcp:101:stat.0 Request processed in 11471us (13008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582088.936354:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 53 00000100:00100000:2.0:1788582089.002298:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582089.002374:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001979136 00000100:00100000:0.0:1788582089.002382:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001979136 00000100:00100000:0.0:1788582089.002443:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 54 00000100:00100000:0.0:1788582089.002453:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+39:10357:x1875464001979136:12345-192.168.201.12@tcp:36:truncate.0 00010000:00010000:0.0:1788582089.002515:0:10137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582089.002541:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a6fd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c915d expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.002556:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:0.0:1788582089.002560:0:10137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788582089.002750:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a6fdd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.002761:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a6fdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.002768:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a6fdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788582089.002833:0:10137:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:0.0:1788582089.002856:0:10137:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000608c5d2e reply state 0000000080284751 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a6fdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582089.002863:0:10137:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788582089.002966:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaef9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+41:10357:x1875464001979136:12345-192.168.201.12@tcp:36:truncate.0 Request processed in 514us (675us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788582089.002974:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 54 00000020:00080000:0.0:1788582089.002978:0:10137:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:2.0:1788582089.003960:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788582089.006189:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a6fdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.006225:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a6fdd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.006231:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a6fdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.006234:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089e00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582089.006238:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a6fdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.006242:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a6fdd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.006255:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:3.0:1788582089.006257:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582089.006259:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a6fdd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.006263:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a6fdd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582089.069836:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582089.069895:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582089.069942:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582089.070018:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001979520 00000100:00100000:1.0:1788582089.070035:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001979520 00000100:00100000:1.0:1788582089.070118:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 120 00000100:00100000:1.0:1788582089.070130:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2349:x1875464001979520:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582089.070235:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac140380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2349:x1875464001979520:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 106us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582089.070243:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 120 00000100:00100000:3.0:1788582089.070835:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001979264 00000100:00100000:3.0:1788582089.070842:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001979264 00000100:00100000:3.0:1788582089.070874:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 282 00000100:00100000:3.0:1788582089.070882:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3333450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2349:x1875464001979264:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582089.070930:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3333450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2349:x1875464001979264:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 48us (1104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582089.070937:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 282 00000100:00100000:0.0:1788582089.071053:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001979392 00000100:00100000:0.0:1788582089.071058:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001979392 00000100:00100000:0.0:1788582089.071106:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 55 00000100:00100000:0.0:1788582089.071114:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+5:2350:x1875464001979392:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582089.071143:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaef9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+5:2350:x1875464001979392:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 31us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582089.071149:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 55 00000100:00080000:2.0:1788582089.071333:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788582089.133530:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582089.133588:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001979648 00000100:00100000:1.0:1788582089.133597:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001979648 00000100:00100000:1.0:1788582089.133673:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 55 00000100:00100000:1.0:1788582089.133684:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+40:10371:x1875464001979648:12345-192.168.201.12@tcp:101:stat.0 00010000:00010000:1.0:1788582089.133714:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582089.133739:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6fe4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9164 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.133808:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a6feb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.133822:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a6feb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.133834:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a6feb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.133849:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a6ff2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.133855:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a6ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.133860:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a6ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.133964:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a6ff9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.133973:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a6ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.133979:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a6ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582089.134013:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788582089.134017:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788582089.134038:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a6ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.134051:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a6ff9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.134059:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a6feb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.134065:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a6feb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.134073:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a6feb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.134078:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fc600 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582089.134083:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a6feb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.134100:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a6feb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.134132:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:1.0:1788582089.134135:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582089.134140:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a6feb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.134146:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a6feb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.134159:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a6ff2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.134165:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a6ff2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.134171:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a6ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.134176:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fde00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582089.134178:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a6ff2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.134183:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a6ff2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.134190:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d0da2fafa00) 00010000:00010000:1.0:1788582089.134192:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582089.134195:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a6ff2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.134243:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a6ff2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.134288:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a6fe4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9164 expref: 42 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.134303:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a6ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9164 expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.134310:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:1.0:1788582089.134312:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788582089.134315:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fca00, rc 0) 00000100:00100000:1.0:1788582089.134385:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac142300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+41:10371:x1875464001979648:12345-192.168.201.12@tcp:101:stat.0 Request processed in 703us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582089.134392:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 55 00000100:00100000:2.0:1788582089.239938:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582089.240045:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001979904 00000100:00100000:1.0:1788582089.240056:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001979904 00000100:00100000:1.0:1788582089.240152:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 56 00000100:00100000:1.0:1788582089.240168:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+41:10381:x1875464001979904:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:1.0:1788582089.240224:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582089.240249:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a7000 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c916b expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582089.240340:0:10136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788582089.240468:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a7000 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c916b expref: 43 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.240490:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d85afcc00) 00010000:00010000:1.0:1788582089.240494:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788582089.240509:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a7000 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c916b expref: 43 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.240524:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fdc00, rc 0) 00000100:00100000:1.0:1788582089.240648:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac140a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+42:10381:x1875464001979904:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 478us (711us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1788582089.240664:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 56 00000100:00100000:3.0:1788582089.246481:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582089.246724:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001980160 00000100:00100000:0.0:1788582089.246736:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001980160 00000100:00100000:0.0:1788582089.246797:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 14 00000100:00100000:0.0:1788582089.246808:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+42:10381:x1875464001980160:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:0.0:1788582089.248411:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+43:10381:x1875464001980160:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 1596us (1938us total) trans 4294967340 rc 0/0 00000100:00100000:0.0:1788582089.248425:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 14 00000100:00100000:3.0:1788582089.329008:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582089.329191:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001980416 00000100:00100000:1.0:1788582089.329228:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001980416 00000100:00100000:1.0:1788582089.329291:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 57 00000100:00100000:1.0:1788582089.329301:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+43:10387:x1875464001980416:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:1.0:1788582089.329325:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582089.329344:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a700e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9172 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.329436:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a7015 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.329451:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a6ff9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9164 expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.329460:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a7015 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.329621:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a6ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9164 expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.329636:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a6ff9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9164 expref: 44 pid: 5844 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582089.329677:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf2d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875464020880000:192.168.201.12@tcp:104: 00000100:00100000:1.0:1788582089.329808:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d909e7240 going to sleep for 11 seconds 00000100:00100000:2.0:1788582089.333258:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf2d8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875464020880000:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582089.333290:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a7015 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582089.339254:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582089.339355:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001980544 00000100:00100000:1.0:1788582089.339367:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001980544 00010000:00010000:1.0:1788582089.339410:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a6ff9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9164 expref: 45 pid: 5844 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582089.339446:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 40 00000100:00100000:1.0:1788582089.339456:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+45:2349:x1875464001980544:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788582089.339471:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582089.339484:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a6ff9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9164 expref: 45 pid: 5844 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.339498:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a6ff9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9164 expref: 45 pid: 5844 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.339519:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a6ff9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9164 expref: 45 pid: 5844 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.339536:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:1.0:1788582089.339541:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a7015 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.339551:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a7015 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.339585:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a7015 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.339615:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788582089.339682:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+44:2349:x1875464001980544:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 227us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582089.339690:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 40 00010000:00010000:3.0:1788582089.340461:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a7015 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.340482:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a7015 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582089.340503:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1788582089.341152:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fdc00/0x2bc3aa892c3a700e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9172 expref: 45 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.341179:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a7015 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9172 expref: 44 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.341188:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:3.0:1788582089.341191:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788582089.341194:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fc600, rc 0) 00000100:00100000:3.0:1788582089.341302:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+44:10387:x1875464001980416:12345-192.168.201.12@tcp:101:bash.0 Request processed in 12002us (12305us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1788582089.341311:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 57 00000100:00100000:3.0:1788582089.344982:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582089.345396:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001980800 00000100:00100000:0.0:1788582089.345406:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001980800 00000100:00100000:0.0:1788582089.345489:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 58 00000100:00100000:0.0:1788582089.345499:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+44:10387:x1875464001980800:12345-192.168.201.12@tcp:36:bash.0 00010000:00010000:0.0:1788582089.345788:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7023 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.345806:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7023 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.345837:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7023 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788582089.345884:0:10137:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:0.0:1788582089.345905:0:10137:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005558895e reply state 000000001502d476 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7023 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582089.345914:0:10137:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788582089.346395:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+47:10387:x1875464001980800:12345-192.168.201.12@tcp:36:bash.0 Request processed in 895us (1420us total) trans 4294967343 rc 0/0 00000100:00100000:0.0:1788582089.346403:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 58 00000020:00080000:0.0:1788582089.346407:0:10137:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788582089.351779:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7023 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.351812:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7023 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.351884:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7023 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.351891:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088a00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582089.351897:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7023 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.351904:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7023 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.351921:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:3.0:1788582089.351980:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582089.351986:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7023 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.351992:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7023 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582089.358997:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582089.359450:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001980928 00000100:00100000:2.0:1788582089.359461:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001980928 00000100:00100000:2.0:1788582089.359551:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 59 00000100:00100000:2.0:1788582089.359570:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+46:10387:x1875464001980928:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:2.0:1788582089.359595:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582089.359616:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a702a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9179 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.359707:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7031 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.359721:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a7015 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9172 expref: 47 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.359730:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7031 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.359762:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a7015 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9172 expref: 47 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.359792:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a7015 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9172 expref: 47 pid: 5845 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582089.359806:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac141880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875464020880128:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582089.359904:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d84cfd840 going to sleep for 11 seconds 00000100:00100000:1.0:1788582089.363627:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582089.363734:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac141880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875464020880128:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582089.363762:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7031 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582089.364048:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001981056 00000100:00100000:3.0:1788582089.364056:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001981056 00010000:00010000:3.0:1788582089.364100:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a7015 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9172 expref: 48 pid: 5845 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582089.364194:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 41 00000100:00100000:3.0:1788582089.364237:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+48:2350:x1875464001981056:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582089.364266:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582089.364274:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a7015 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9172 expref: 48 pid: 5845 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.364287:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a7015 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9172 expref: 48 pid: 5845 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.364310:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a7015 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9172 expref: 48 pid: 5845 timeout: 408 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.364325:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:3.0:1788582089.364330:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7031 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.364339:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.364347:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7031 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.364373:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582089.364420:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+47:2350:x1875464001981056:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 218us (803us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582089.364428:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 41 00010000:00010000:2.0:1788582089.364653:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.364662:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582089.364710:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788582089.364714:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788582089.364741:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7031 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.364770:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a702a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9179 expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.364785:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7031 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9179 expref: 46 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.364792:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:2.0:1788582089.364801:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788582089.364804:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04600, rc 0) 00000100:00100000:2.0:1788582089.364846:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+46:10387:x1875464001980928:12345-192.168.201.12@tcp:101:bash.0 Request processed in 5287us (5859us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582089.364853:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 59 00000100:00100000:1.0:1788582089.368591:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582089.368754:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001981312 00000100:00100000:0.0:1788582089.368765:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001981312 00000100:00100000:0.0:1788582089.368857:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 15 00000100:00100000:0.0:1788582089.368868:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d84f82050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+46:10387:x1875464001981312:12345-192.168.201.12@tcp:35:bash.0 00000100:00100000:0.0:1788582089.369116:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d84f82050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+47:10387:x1875464001981312:12345-192.168.201.12@tcp:35:bash.0 Request processed in 249us (537us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1788582089.369124:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 15 00010000:00010000:3.0:1788582089.454559:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582089.473510:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582089.473589:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001981568 00000100:00100000:3.0:1788582089.473597:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001981568 00000100:00100000:3.0:1788582089.473648:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 60 00000100:00100000:3.0:1788582089.473656:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+47:10397:x1875464001981568:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:3.0:1788582089.473696:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582089.473721:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7038 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9180 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582089.473822:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1788582089.473920:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7038 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9180 expref: 49 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.473931:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d85afcc00) 00010000:00010000:3.0:1788582089.473933:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788582089.473937:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7038 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9180 expref: 49 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.473947:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27a00, rc 0) 00000100:00100000:3.0:1788582089.474004:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+48:10397:x1875464001981568:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 349us (504us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1788582089.474009:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 60 00000100:00100000:1.0:1788582089.476130:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582089.476255:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001981696 00000100:00100000:0.0:1788582089.476263:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001981696 00000100:00100000:0.0:1788582089.476331:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 61 00000100:00100000:0.0:1788582089.476339:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+48:10397:x1875464001981696:12345-192.168.201.12@tcp:34:lfs.0 00010000:00010000:0.0:1788582089.476396:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a7046 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476409:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a7046 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476428:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a7046 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476492:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a704d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476497:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a704d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476502:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a704d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476577:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7054 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476583:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476587:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788582089.476617:0:10137:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476626:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a7046 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476631:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a7046 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476635:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a7046 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476646:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582089.476649:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a7046 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476654:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a7046 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476664:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:0.0:1788582089.476667:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582089.476670:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a7046 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476677:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a7046 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476689:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a704d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476695:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a704d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476700:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a704d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476705:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582089.476708:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a704d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476714:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a704d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476730:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d0d888de000) 00010000:00010000:0.0:1788582089.476733:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582089.476736:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a704d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476742:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a704d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476756:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7054 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476762:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7054 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476768:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7054 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476773:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582089.476776:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7054 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476780:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7054 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476786:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:0.0:1788582089.476787:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582089.476789:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7054 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.476792:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7054 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582089.476860:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+48:10397:x1875464001981696:12345-192.168.201.12@tcp:34:lfs.0 Request processed in 522us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582089.476865:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 61 00000100:00100000:0.0:1788582089.478955:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582089.479052:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001981952 00000100:00100000:1.0:1788582089.479064:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001981952 00000100:00100000:1.0:1788582089.479192:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 16 00000100:00100000:1.0:1788582089.479236:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+48:10397:x1875464001981952:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:1.0:1788582089.479466:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+49:10397:x1875464001981952:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 263us (514us total) trans 4294967346 rc 0/0 00000100:00100000:1.0:1788582089.479484:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 16 00000100:00100000:1.0:1788582089.503148:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582089.503230:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001982208 00000100:00100000:2.0:1788582089.503239:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001982208 00000100:00100000:2.0:1788582089.503314:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 62 00000100:00100000:2.0:1788582089.503322:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+49:10400:x1875464001982208:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:2.0:1788582089.503344:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582089.503360:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a705b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9187 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503421:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7062 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503440:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503448:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503458:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7069 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503462:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503466:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503588:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503595:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503599:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582089.503606:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788582089.503688:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503695:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7062 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503702:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503707:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582089.503712:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503720:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7062 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503732:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:2.0:1788582089.503734:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582089.503739:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7062 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503755:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7062 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503769:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503775:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7069 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503781:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503786:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582089.503790:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503795:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7069 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503803:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d0d85afcf00) 00010000:00010000:2.0:1788582089.503806:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582089.503808:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7069 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503814:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7069 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503855:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a705b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9187 expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503869:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9187 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.503883:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:2.0:1788582089.503886:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788582089.503888:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05200, rc 0) 00000100:00100000:2.0:1788582089.503960:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+51:10400:x1875464001982208:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 638us (823us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1788582089.503967:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 62 00000100:00100000:3.0:1788582089.506415:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582089.506449:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582089.506457:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001982336 00000100:00100000:1.0:1788582089.506467:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001982336 00000100:00100000:2.0:1788582089.506561:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001982464 00000100:00100000:2.0:1788582089.506567:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001982464 00000100:00100000:1.0:1788582089.506606:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 63 00000100:00100000:2.0:1788582089.506607:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 4 00000100:00100000:2.0:1788582089.506616:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+52:2351:x1875464001982464:12345-192.168.201.12@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1788582089.506616:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+52:10400:x1875464001982336:12345-192.168.201.12@tcp:54:lfs.0 00010000:00010000:2.0:1788582089.506630:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582089.506654:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7070 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9187 expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.506675:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a707e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.506689:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a707e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.506714:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a707e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.506742:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a707e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.506749:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a707e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.506755:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a707e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.506762:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fde00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582089.506766:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a707e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.506774:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a707e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.506785:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:1.0:1788582089.506788:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788582089.506792:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a707e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582089.506797:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a707e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.506803:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:2.0:1788582089.506806:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788582089.506994:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+51:10400:x1875464001982336:12345-192.168.201.12@tcp:54:lfs.0 Request processed in 378us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582089.507002:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 63 00000100:00100000:2.0:1788582089.507173:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc78380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+50:2351:x1875464001982464:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 558us (722us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582089.507180:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 4 00000100:00100000:0.0:1788582089.508601:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582089.508673:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001982720 00000100:00100000:3.0:1788582089.508683:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001982720 00000100:00100000:3.0:1788582089.508732:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 17 00000100:00100000:3.0:1788582089.508742:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+50:10400:x1875464001982720:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:3.0:1788582089.508937:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+51:10400:x1875464001982720:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 197us (342us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788582089.508942:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 17 00000100:00100000:3.0:1788582089.585066:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582089.585264:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001982976 00000100:00100000:0.0:1788582089.585273:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001982976 00000100:00100000:0.0:1788582089.585322:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 64 00000100:00100000:0.0:1788582089.585330:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+51:10418:x1875464001982976:12345-192.168.201.12@tcp:101:cat.0 00010000:00010000:0.0:1788582089.585352:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582089.585369:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a7085 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c918e expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.585456:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a708c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.585484:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a708c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.585496:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a708c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582089.585505:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788582089.585617:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a7085 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c918e expref: 54 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.585630:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a708c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c918e expref: 53 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.585653:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:0.0:1788582089.585655:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788582089.585658:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7088200, rc 0) 00000100:00100000:0.0:1788582089.585725:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+53:10418:x1875464001982976:12345-192.168.201.12@tcp:101:cat.0 Request processed in 394us (680us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1788582089.585732:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 64 00000100:00100000:1.0:1788582089.597541:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582089.597704:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001983104 00000100:00100000:2.0:1788582089.597714:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001983104 00000100:00100000:2.0:1788582089.597774:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 65 00000100:00100000:2.0:1788582089.597785:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+53:10419:x1875464001983104:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:2.0:1788582089.597810:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582089.597830:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a709a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9195 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.597910:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a70a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.597922:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a70a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.597931:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a70a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582089.597960:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788582089.597963:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788582089.597976:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a70a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.597995:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a709a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9195 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.598008:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a70a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9195 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582089.598013:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:2.0:1788582089.598015:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788582089.598018:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05400, rc 0) 00000100:00100000:2.0:1788582089.598177:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+54:10419:x1875464001983104:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 394us (644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582089.598182:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 65 00000100:00100000:1.0:1788582089.600915:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582089.600976:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001983488 00000100:00100000:0.0:1788582089.600986:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001983488 00000100:00100000:0.0:1788582089.601032:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 18 00000100:00100000:0.0:1788582089.601051:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+54:10419:x1875464001983488:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:0.0:1788582089.601378:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+55:10419:x1875464001983488:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 337us (468us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1788582089.601387:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 18 00000100:00100000:1.0:1788582089.603020:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582089.603188:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001983616 00000100:00100000:0.0:1788582089.603197:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001983616 00000100:00100000:0.0:1788582089.603277:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 5 00000100:00100000:0.0:1788582089.603287:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+55:10419:x1875464001983616:12345-192.168.201.12@tcp:103:lfs.0 00010000:00010000:0.0:1788582089.603299:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788582089.603320:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7031 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9179 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.603334:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a708c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c918e expref: 54 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.603342:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a6f3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c913a expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.603361:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:0.0:1788582089.603370:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788582089.603443:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+52:10419:x1875464001983616:12345-192.168.201.12@tcp:103:lfs.0 Request processed in 158us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582089.603448:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 5 00000100:00100000:1.0:1788582089.604682:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582089.604778:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001983744 00000100:00100000:0.0:1788582089.604785:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001983744 00000100:00100000:0.0:1788582089.604824:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 66 00000100:00100000:0.0:1788582089.604833:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+52:10419:x1875464001983744:12345-192.168.201.12@tcp:58:lfs.0 00010000:00010000:0.0:1788582089.604943:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a70a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.604954:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a70a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582089.604962:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a70a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788582089.605254:0:10136:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788582089.605399:0:10136:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1788582089.605451:0:10136:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1788582089.605604:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+52:10419:x1875464001983744:12345-192.168.201.12@tcp:58:lfs.0 Request processed in 770us (926us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582089.605612:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 66 00000100:00100000:1.0:1788582089.616575:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582089.616654:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001983872 00000100:00100000:3.0:1788582089.616764:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001983872 00000100:00100000:3.0:1788582089.616817:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 67 00000100:00100000:3.0:1788582089.616825:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+52:10421:x1875464001983872:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:3.0:1788582089.616842:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582089.616859:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a70af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c919c expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.616912:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a70b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.616922:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a70b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.616930:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a70b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.616941:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a70bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.616945:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a70bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.616949:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a70bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.617016:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a70c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.617021:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a70c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.617038:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a70c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582089.617070:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788582089.617075:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788582089.617107:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a70c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.617119:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a70c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.617126:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a70b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.617130:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a70b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.617135:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a70b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.617138:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582089.617141:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a70b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.617146:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a70b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.617154:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:3.0:1788582089.617156:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582089.617159:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a70b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.617173:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a70b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.617182:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a70bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.617185:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a70bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.617189:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a70bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.617192:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582089.617194:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a70bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.617197:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a70bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.617242:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d0d917bda00) 00010000:00010000:3.0:1788582089.617245:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582089.617247:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a70bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.617252:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a70bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.617284:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a70af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c919c expref: 54 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.617297:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a70c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c919c expref: 53 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582089.617310:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:3.0:1788582089.617312:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788582089.617314:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27800, rc 0) 00000100:00100000:3.0:1788582089.617370:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+53:10421:x1875464001983872:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 545us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582089.617378:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 67 00000040:00080000:0.0:1788582090.290348:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788582090.290358:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788582090.290434:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788582090.290443:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788582090.290574:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b36d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875464020880256:192.168.201.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788582090.290664:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbfb25600 going to sleep for 11 seconds 00000100:00100000:3.0:1788582090.299237:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582090.299357:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b36d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875464020880256:192.168.201.12@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788582090.299704:0:5855:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001984000 00000100:00100000:2.0:1788582090.299713:0:5855:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001984000 00000100:00100000:2.0:1788582090.299778:0:5855:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 1 00000100:00100000:2.0:1788582090.299788:0:5855:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b99087a3-3c83-4416-b2b9-d522b9885111+53:10432:x1875464001984000:12345-192.168.201.12@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788582090.299865:0:5855:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b99087a3-3c83-4416-b2b9-d522b9885111+53:10432:x1875464001984000:12345-192.168.201.12@tcp:900:lhsmtool_posix.0 Request processed in 78us (667us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582090.299874:0:5855:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 1 00000100:00100000:1.0:1788582090.303454:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582090.309548:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001984128 00000100:00100000:2.0:1788582090.309564:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001984128 00000100:00100000:2.0:1788582090.309633:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 68 00000100:00100000:2.0:1788582090.309644:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+53:10432:x1875464001984128:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788582090.309679:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788582090.309799:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab900e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+53:10432:x1875464001984128:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 Request processed in 157us (6358us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582090.309807:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 68 00000100:00100000:2.0:1788582090.323066:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582090.323195:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001984256 00000100:00100000:0.0:1788582090.323230:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001984256 00000100:00100000:0.0:1788582090.323287:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 69 00000100:00100000:0.0:1788582090.323300:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+53:10432:x1875464001984256:12345-192.168.201.12@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788582090.323390:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a70cb lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.323573:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a70cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.323588:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a70cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.323606:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a70d2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.323613:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a70d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.323619:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a70d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.323644:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a70d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.323653:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a70d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.323672:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a70d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582090.323709:0:10136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788582090.323714:0:10136:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788582090.323727:0:10136:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a70d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.323738:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a70cb lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.323745:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a70cb lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.323751:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a70cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.323757:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582090.323761:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a70cb lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.323768:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a70cb lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.323781:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d0d888de500) 00010000:00010000:0.0:1788582090.323784:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582090.323788:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a70cb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.323795:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a70cb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.324601:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a70d2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.324613:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a70d2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.324621:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a70d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.324626:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088600 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582090.324629:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a70d2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.324637:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a70d2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.324648:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff8d0d888def00) 00010000:00010000:0.0:1788582090.324652:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582090.324655:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a70d2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.324661:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a70d2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.324677:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a70d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.324685:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a70d9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.324690:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a70d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.324702:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582090.324706:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a70d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.324712:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a70d9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.324721:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:0.0:1788582090.324724:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582090.324726:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a70d9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.324733:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a70d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582090.324823:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac141880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+53:10432:x1875464001984256:12345-192.168.201.12@tcp:34:lhsmtool_posix.0 Request processed in 1522us (1762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582090.324833:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 69 00000100:00100000:2.0:1788582090.334292:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582090.334372:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001984512 00000100:00100000:3.0:1788582090.334381:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001984512 00000100:00100000:3.0:1788582090.334438:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 70 00000100:00100000:3.0:1788582090.334447:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+53:10432:x1875464001984512:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788582090.334467:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582090.334484:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a70e0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c91a3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.334577:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a70e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.334591:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a70e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.334601:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a70e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582090.334611:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788582090.334693:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a70e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.334717:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a70e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.334724:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a70e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.334730:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27a00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582090.334734:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a70e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.334741:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a70e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.334753:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:3.0:1788582090.334755:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788582090.334760:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a70e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.334766:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a70e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.334801:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a70e0 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91a3 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.334821:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d0d888de500) 00010000:00010000:3.0:1788582090.334823:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788582090.334827:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a70e0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91a3 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.334836:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26200, rc 0) 00000100:00100000:3.0:1788582090.334890:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac143b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+54:10432:x1875464001984512:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 443us (608us total) trans 4294967351 rc 301/301 00000100:00100000:3.0:1788582090.334897:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 70 00000100:00100000:0.0:1788582090.348508:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582090.348714:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001984640 00000100:00100000:3.0:1788582090.348725:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001984640 00000100:00100000:3.0:1788582090.348786:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 71 00000100:00100000:3.0:1788582090.348797:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+54:10432:x1875464001984640:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788582090.348831:0:10137:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788582090.348934:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+54:10432:x1875464001984640:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 Request processed in 139us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582090.348942:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 71 00000100:00100000:2.0:1788582090.363950:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582090.364099:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001984896 00000100:00100000:1.0:1788582090.364111:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001984896 00000100:00100000:1.0:1788582090.364182:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 72 00000100:00100000:1.0:1788582090.364196:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+54:10432:x1875464001984896:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788582090.364248:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582090.364251:0:10136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788582090.364284:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a70a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9195 expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.364303:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:1.0:1788582090.364309:0:10136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788582090.364327:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a70f5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c91aa expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788582090.365091:0:10136:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:1.0:1788582090.365338:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a70fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.370965:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a70fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.370982:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a70fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.371130:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a70f5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91aa expref: 56 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.371152:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a70fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91aa expref: 55 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.371162:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d0da2fafa00) 00010000:00010000:1.0:1788582090.371165:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788582090.371168:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fcc00, rc 0) 00000100:00100000:1.0:1788582090.371269:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac140700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+55:10432:x1875464001984896:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 7075us (7329us total) trans 4294967352 rc 0/0 00000100:00100000:1.0:1788582090.371278:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 72 00000100:00100000:3.0:1788582090.377602:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582090.377688:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001985152 00000100:00100000:2.0:1788582090.377699:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001985152 00000100:00100000:2.0:1788582090.377757:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 73 00000100:00100000:2.0:1788582090.377767:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+55:10432:x1875464001985152:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788582090.377823:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582090.377849:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a70fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91aa expref: 55 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.377868:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d0da2fafa00) 00010000:00010000:2.0:1788582090.377879:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788582090.377912:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a710a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.377925:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a710a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.377936:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a710a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.377988:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05600/0x2bc3aa892c3a7111 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xde7b2b0c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.377996:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05600/0x2bc3aa892c3a7111 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xde7b2b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.378003:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05600/0x2bc3aa892c3a7111 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xde7b2b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.378062:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a710a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.378082:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a710a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.378089:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a710a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.378096:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04a00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582090.378100:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a710a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.378106:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a710a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.378124:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:2.0:1788582090.378126:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582090.378130:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a710a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.378136:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a710a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.378146:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05600/0x2bc3aa892c3a7111 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xde7b2b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.378153:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05600/0x2bc3aa892c3a7111 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xde7b2b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.378158:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05600/0x2bc3aa892c3a7111 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xde7b2b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.378163:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05600 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582090.378165:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05600/0x2bc3aa892c3a7111 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xde7b2b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.378172:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05600/0x2bc3aa892c3a7111 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xde7b2b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.378179:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xde7b2b0c (ffff8d0d85afcf00) 00010000:00010000:2.0:1788582090.378181:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582090.378184:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05600/0x2bc3aa892c3a7111 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xde7b2b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.378190:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05600/0x2bc3aa892c3a7111 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xde7b2b0c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582090.378315:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+54:10432:x1875464001985152:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 Request processed in 548us (727us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788582090.378323:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 73 00000100:00100000:0.0:1788582090.382648:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582090.382793:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001985280 00000100:00100000:3.0:1788582090.382804:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001985280 00000100:00100000:3.0:1788582090.382858:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 74 00000100:00100000:3.0:1788582090.382867:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+54:10432:x1875464001985280:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788582090.382889:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582090.382913:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7118 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c91b1 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.382949:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a711f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.382963:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a711f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.382974:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a711f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.383102:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7118 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91b1 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.383120:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a711f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91b1 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.383128:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:3.0:1788582090.383130:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788582090.383133:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27a00, rc 0) 00000100:00100000:3.0:1788582090.383223:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+55:10432:x1875464001985280:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 337us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582090.383230:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 74 00000100:00100000:2.0:1788582090.391385:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582090.391489:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001985536 00000100:00100000:0.0:1788582090.391499:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001985536 00000100:00100000:0.0:1788582090.391563:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 75 00000100:00100000:0.0:1788582090.391574:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+55:10432:x1875464001985536:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788582090.391656:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a7126 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.391684:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a7126 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.391707:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a7126 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788582090.392197:0:10136:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1788582090.392234:0:10136:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 309386031079ns, next at 310386028464ns, rc = 0 00000004:00010000:0.0:1788582090.392613:0:10136:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000018b2d7ce reply state 0000000090a8ae41 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a7126 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582090.392624:0:10136:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788582090.392857:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac143800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+57:10432:x1875464001985536:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 Request processed in 1282us (1481us total) trans 4294967353 rc 0/0 00000100:00100000:0.0:1788582090.392866:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 75 00010000:00010000:3.0:1788582090.394628:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a7126 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.394645:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a7126 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.394653:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a7126 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.394658:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582090.394663:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a7126 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.394670:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a7126 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.394697:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:3.0:1788582090.394714:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788582090.394719:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a7126 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.394725:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a7126 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582090.402868:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582090.411525:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001985664 00000100:00100000:3.0:1788582090.411544:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001985664 00000100:00100000:3.0:1788582090.411625:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 76 00000100:00100000:3.0:1788582090.411636:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+56:10432:x1875464001985664:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788582090.411663:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582090.411694:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a712d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c91b8 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.411759:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a712d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91b8 expref: 57 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.411773:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a712d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91b8 expref: 57 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.411793:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:3.0:1788582090.411796:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788582090.411800:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26200, rc 0) 00000100:00100000:3.0:1788582090.411861:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac140e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+57:10432:x1875464001985664:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 227us (9003us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582090.411868:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 76 00000100:00100000:1.0:1788582090.434682:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582090.434798:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001985792 00000100:00100000:3.0:1788582090.434808:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001985792 00000100:00100000:3.0:1788582090.434857:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 24 00000100:00100000:3.0:1788582090.434866:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab900a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2348:x1875464001985792:12345-192.168.201.12@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1788582090.434905:0:6693:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp t0 exp 0000000000000000 cur 309 last 0 00000020:00000080:3.0:1788582090.434938:0:6693:0:(genops.c:1385:class_connect()) connect: client b99087a3-3c83-4416-b2b9-d522b9885111, cookie 0x2bc3aa892c3a7134 00002000:00100000:3.0:1788582090.434954:0:6693:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b99087a3-3c83-4416-b2b9-d522b9885111/ffff8d0d86997000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788582090.434981:0:6693:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788582090.435253:0:6693:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788582090.435285:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8d0d86992000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788582090.435376:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab900a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+6:2348:x1875464001985792:12345-192.168.201.12@tcp:8:lhsmtool_posix.0 Request processed in 509us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582090.435385:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 24 00000100:00100000:3.0:1788582090.439599:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582090.439735:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001985920 00000100:00100000:1.0:1788582090.439744:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001985920 00000100:00100000:1.0:1788582090.439809:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 25 00000100:00100000:1.0:1788582090.439820:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+6:0:x1875464001985920:12345-192.168.201.12@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1788582090.440570:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:2.0:1788582090.450280:0:12000:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788582090.450292:0:12000:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788582090.450365:0:12000:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788582090.450371:0:12000:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788582090.479106:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788582090.485087:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:0.0:1788582090.485108:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b99087a3-3c83-4416-b2b9-d522b9885111 00000100:00100000:0.0:1788582090.485619:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+5:0:x1875464001985920:12345-192.168.201.12@tcp:2:lhsmtool_posix.0 Request processed in 45793us (46021us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788582090.485632:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 25 00000100:00100000:2.0:1788582090.495045:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582090.497127:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001986176 00000100:00100000:0.0:1788582090.497143:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001986176 00000100:00100000:0.0:1788582090.497227:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 19 00000100:00100000:0.0:1788582090.497239:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+57:10432:x1875464001986176:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788582090.498172:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac142a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+58:10432:x1875464001986176:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 Request processed in 929us (3130us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788582090.498183:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 19 00000100:00100000:2.0:1788582090.506797:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582090.506878:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001986432 00000100:00100000:1.0:1788582090.506890:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001986432 00000100:00100000:1.0:1788582090.506953:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 77 00000100:00100000:1.0:1788582090.506964:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+58:10432:x1875464001986432:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788582090.507109:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac141f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+58:10432:x1875464001986432:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 Request processed in 145us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582090.507117:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 77 00000100:00100000:1.0:1788582090.510284:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582090.510731:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001986560 00000100:00100000:2.0:1788582090.510742:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001986560 00000100:00100000:2.0:1788582090.510802:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 78 00000100:00100000:2.0:1788582090.510813:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+58:10432:x1875464001986560:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788582090.510834:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582090.510856:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a713b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c91bf expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.510927:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7142 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.510942:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.510952:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582090.511021:0:10136:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788582090.511045:0:10136:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7142 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.511083:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a713b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91bf expref: 60 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.511102:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7142 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91bf expref: 59 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.511110:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:2.0:1788582090.511113:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788582090.511117:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04e00, rc 0) 00000100:00100000:2.0:1788582090.511186:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab901180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+59:10432:x1875464001986560:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 375us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582090.511191:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 78 00000100:00100000:0.0:1788582090.520433:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582090.520761:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001986688 00000100:00100000:3.0:1788582090.520772:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001986688 00000100:00100000:3.0:1788582090.520833:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 26 00000100:00100000:3.0:1788582090.520844:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+5:2352:x1875464001986688:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788582090.520864:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582090.520895:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006514b1a3/0x2bc3aa892c3a7149 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c91c6 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788582090.520922:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b98ca, blocks: 0x1 00010000:00010000:3.0:1788582090.520939:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=309s v=(0 0) 00010000:00010000:3.0:1788582090.520943:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582090.520953:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006514b1a3/0x2bc3aa892c3a7149 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91c6 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.520993:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006514b1a3/0x2bc3aa892c3a7149 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91c6 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.521007:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27200, rc 0) 00000100:00100000:3.0:1788582090.521084:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b37800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+6:2352:x1875464001986688:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 242us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582090.521091:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 26 00000100:00100000:3.0:1788582090.524975:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582090.525055:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001986944 00000100:00100000:0.0:1788582090.525083:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001986944 00000100:00100000:0.0:1788582090.525148:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 79 00000100:00100000:0.0:1788582090.525160:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+59:10432:x1875464001986944:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788582090.525325:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+59:10432:x1875464001986944:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 Request processed in 167us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582090.525334:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 79 00000100:00100000:1.0:1788582090.535828:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582090.536043:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001987072 00000100:00100000:3.0:1788582090.536053:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001987072 00000100:00100000:3.0:1788582090.536124:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 27 00000100:00100000:3.0:1788582090.536136:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab901880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+6:10432:x1875464001987072:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788582090.536155:0:8034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582090.536175:0:8034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dc4f75b/0x2bc3aa892c3a7150 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c91cd expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.536241:0:8034:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006514b1a3/0x2bc3aa892c3a7149 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91c6 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.536251:0:8034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582090.536256:0:8034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582090.536261:0:8034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dc4f75b/0x2bc3aa892c3a7150 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91cd expref: 7 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.536298:0:8034:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006514b1a3/0x2bc3aa892c3a7149 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91c6 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.536324:0:8034:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006514b1a3/0x2bc3aa892c3a7149 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91c6 expref: 7 pid: 6693 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582090.536338:0:8034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8034:1875464020880384:192.168.201.12@tcp:104: 00000100:00100000:3.0:1788582090.536559:0:8034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da791d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788582090.544368:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582090.544607:0:8034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8034:1875464020880384:192.168.201.12@tcp:104: 00010000:00010000:3.0:1788582090.544645:0:8034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002dc4f75b/0x2bc3aa892c3a7150 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91cd expref: 7 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.544667:0:8034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27400, rc 0) 00000100:00100000:3.0:1788582090.544740:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab901880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+7:10432:x1875464001987072:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 8605us (8921us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582090.544750:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 27 00000100:00100000:0.0:1788582090.544893:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001987200 00000100:00100000:0.0:1788582090.544901:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001987200 00010000:00010000:0.0:1788582090.544936:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006514b1a3/0x2bc3aa892c3a7149 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91c6 expref: 7 pid: 6693 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582090.544974:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 42 00000100:00100000:0.0:1788582090.544983:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da7247850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99087a3-3c83-4416-b2b9-d522b9885111+7:2349:x1875464001987200:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788582090.544996:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582090.545018:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006514b1a3/0x2bc3aa892c3a7149 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91c6 expref: 7 pid: 6693 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.545033:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006514b1a3/0x2bc3aa892c3a7149 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91c6 expref: 7 pid: 6693 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.545056:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006514b1a3/0x2bc3aa892c3a7149 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91c6 expref: 7 pid: 6693 timeout: 409 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.545081:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582090.545085:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582090.545093:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002dc4f75b/0x2bc3aa892c3a7150 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91cd expref: 6 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.545111:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dc4f75b/0x2bc3aa892c3a7150 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91cd expref: 6 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.545145:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000002dc4f75b/0x2bc3aa892c3a7150 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91cd expref: 6 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582090.545160:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b34e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5830:1875464020880512:192.168.201.12@tcp:105: 00000100:00100000:0.0:1788582090.545278:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8a9349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788582090.551182:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582090.551309:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b34e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5830:1875464020880512:192.168.201.12@tcp:105: 00010000:00010000:0.0:1788582090.551334:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788582090.551398:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da7247850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99087a3-3c83-4416-b2b9-d522b9885111+6:2349:x1875464001987200:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 6415us (7037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582090.551418:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 42 00000100:00100000:2.0:1788582090.551521:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001987328 00000100:00100000:2.0:1788582090.551530:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001987328 00002000:00100000:2.0:1788582090.551582:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8d0dabdd1500 x1875464001987328/t0(0) o4->b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp:691/0 lens 504/0 e 0 to 0 dl 1788582101 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788582090.551594:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0dabdd1500 with x1875464001987328 ext(0->8) 00002000:00010000:2.0:1788582090.551600:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0dabdd1500 00000100:00100000:2.0:1788582090.551635:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 0 00000100:00100000:2.0:1788582090.551645:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b99087a3-3c83-4416-b2b9-d522b9885111+6:2349:x1875464001987328:12345-192.168.201.12@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788582090.552393:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b99087a3-3c83-4416-b2b9-d522b9885111+8:2349:x1875464001987328:12345-192.168.201.12@tcp:4:lhsmtool_posix.0 Request processed in 745us (1217us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788582090.552410:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 0 00002000:00100000:2.0:1788582090.552419:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff8d0dabdd1500 x1875464001987328/t4294967302(0) o4->b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp:691/0 lens 504/448 e 0 to 0 dl 1788582101 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788582090.552427:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0dabdd1500 with x1875464001987328 ext(0->8) 00002000:00010000:2.0:1788582090.552431:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0dabdd1500 00000100:00100000:3.0:1788582090.571626:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582090.572977:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001987456 00000100:00100000:2.0:1788582090.572991:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001987456 00000100:00100000:2.0:1788582090.573062:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 80 00000100:00100000:2.0:1788582090.573086:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+59:10432:x1875464001987456:12345-192.168.201.12@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1788582090.727009:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc59500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+59:10432:x1875464001987456:12345-192.168.201.12@tcp:44:lhsmtool_posix.0 Request processed in 153918us (155384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582090.727144:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 80 00000001:00080000:3.0:1788582090.730765:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:3.0:1788582090.730784:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:3.0:1788582090.730892:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788582090.730912:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d0d857d9a80 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788582090.730916:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d0dbaf19a00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d0d857d9c00 00000020:00080000:3.0:1788582090.730919:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d0dbaf19300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d0dbf435c00 00000100:00100000:0.0:1788582090.730936:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788582090.730956:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020880640:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788582090.731018:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582090.731099:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788582090.731107:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbc58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020880768:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788582090.739803:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788582090.739878:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:3.0:1788582090.740054:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788582090.740082:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020880640 00000100:00100000:3.0:1788582090.740091:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020880640 00000100:00100000:3.0:1788582090.740308:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020880768 00000100:00100000:3.0:1788582090.740312:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020880768 00000100:00100000:3.0:1788582090.740341:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788582090.740355:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020880640:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1788582090.740544:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788582090.740549:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:3.0:1788582090.740568:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788582090.740572:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788582090 00002000:00010000:3.0:1788582090.740575:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788582090.740577:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788582090 -> 1788582090 00002000:00010000:3.0:1788582090.740579:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1788582090.740638:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3307:x1875464020880640:12345-0@lo:2:osp-syn-1-0.0 Request processed in 288us (9619us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788582090.740647:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788582090.740667:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788582090.740675:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875464020880768:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788582090.740690:0:6693:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1788582090.740714:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a9b98c7, atime: 0x6a9b98c7, ctime: 0x6a9b98c7, blocks: 0xb 00010000:00010000:3.0:1788582090.740722:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4d69f34/0x2bc3aa892c3a7157 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.740737:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=309s v=(0 0) 00010000:00010000:3.0:1788582090.740741:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582090.740748:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e4d69f34/0x2bc3aa892c3a7157 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.740770:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e4d69f34/0x2bc3aa892c3a7157 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.740780:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e4d69f34/0x2bc3aa892c3a7157 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.740787:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e4d69f34/0x2bc3aa892c3a7157 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.740803:0:6693:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788582090.741125:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d0d85b34e00/2, rc 0, transno 4294967303 00000100:00100000:0.0:1788582090.741132:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020880640:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788582090.741284:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1875464020880768:12345-0@lo:6:osp-syn-0-0.0 Request processed in 611us (1488us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788582090.741291:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788582090.741581:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582090.741648:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001987584 00000100:00100000:0.0:1788582090.741659:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001987584 00010000:00010000:2.0:1788582090.742249:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582090.742258:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e4d69f34/0x2bc3aa892c3a7157 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.742267:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26800 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582090.742272:0:7637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4d69f34/0x2bc3aa892c3a7157 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.742281:0:7637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e4d69f34/0x2bc3aa892c3a7157 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.742302:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e4d69f34/0x2bc3aa892c3a7157 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.742310:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e4d69f34/0x2bc3aa892c3a7157 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.742355:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582090.742357:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582090.742359:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788582090.743447:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d0dbbc58000/2, rc 0, transno 4294967301 00000100:00100000:3.0:1788582090.743569:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbc58000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020880768:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788582090.743730:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 30 00000100:00100000:0.0:1788582090.743743:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+8:2350:x1875464001987584:12345-192.168.201.12@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788582090.791812:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1788582090.791838:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:0.0:1788582090.792032:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf431c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+6:2350:x1875464001987584:12345-192.168.201.12@tcp:16:lhsmtool_posix.0 Request processed in 48285us (50443us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582090.792044:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 30 00000100:00100000:3.0:1788582090.804731:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582090.804858:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001987840 00000100:00100000:2.0:1788582090.804872:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001987840 00000100:00100000:2.0:1788582090.804947:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 81 00000100:00100000:2.0:1788582090.804959:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+13:10432:x1875464001987840:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788582090.805019:0:10136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582090.805048:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7142 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91bf expref: 13 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.805134:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:2.0:1788582090.805140:0:10136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788582090.805177:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a715e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.805192:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a715e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.805257:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a715e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788582090.805963:0:10136:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b594607f reply state 000000009e3797dc transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a715e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582090.805974:0:10136:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788582090.806143:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+14:10432:x1875464001987840:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 Request processed in 1184us (1420us total) trans 4294967355 rc 0/0 00000100:00100000:2.0:1788582090.806169:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 81 00010000:00010000:2.0:1788582090.813904:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a715e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.813922:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a715e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.813939:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a715e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.813946:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582090.813951:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a715e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.813960:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a715e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.813978:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:2.0:1788582090.813982:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582090.813986:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a715e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.813991:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a715e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582090.815010:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582090.817836:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001987968 00000100:00100000:2.0:1788582090.817851:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001987968 00000100:00100000:2.0:1788582090.817923:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 31 00000100:00100000:2.0:1788582090.817935:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+6:2349:x1875464001987968:12345-192.168.201.12@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788582090.818198:0:8034:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1788582090.818236:0:8034:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788582090 -> 1788582089 00002000:00010000:2.0:1788582090.818239:0:8034:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788582087 00002000:00010000:2.0:1788582090.818241:0:8034:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788582090 -> 1788582089 00002000:00010000:2.0:1788582090.818243:0:8034:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788582090.818319:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf432680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+7:2349:x1875464001987968:12345-192.168.201.12@tcp:2:lhsmtool_posix.0 Request processed in 386us (3315us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788582090.818327:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 31 00000100:00100000:3.0:1788582090.821940:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582090.822029:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001988224 00000100:00100000:1.0:1788582090.822039:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001988224 00000100:00100000:1.0:1788582090.822110:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 82 00000100:00100000:1.0:1788582090.822121:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+13:10432:x1875464001988224:12345-192.168.201.12@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788582090.822192:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7165 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.822237:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a711f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91b1 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.822247:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7165 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.822283:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a711f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91b1 expref: 13 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.822297:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a711f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91b1 expref: 13 pid: 5845 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582090.822312:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab903b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875464020880896:192.168.201.12@tcp:104: 00000100:00100000:1.0:1788582090.822420:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d909e7000 going to sleep for 11 seconds 00000100:00100000:1.0:1788582090.823794:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab903b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875464020880896:192.168.201.12@tcp:104: 00010000:00010000:1.0:1788582090.823818:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7165 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582090.825640:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582090.826682:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001988352 00000100:00100000:0.0:1788582090.826695:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001988352 00010000:00010000:0.0:1788582090.826739:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a711f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91b1 expref: 14 pid: 5845 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582090.826785:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 43 00000100:00100000:0.0:1788582090.826796:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf430380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+14:2350:x1875464001988352:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788582090.826811:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582090.826818:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a711f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91b1 expref: 14 pid: 5845 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.826833:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a711f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91b1 expref: 14 pid: 5845 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.826853:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a711f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91b1 expref: 14 pid: 5845 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.826871:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:0.0:1788582090.826876:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7165 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.826899:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7165 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.826907:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7165 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.826941:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788582090.827006:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf430380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+13:2350:x1875464001988352:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 211us (1374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582090.827014:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 43 00010000:00010000:1.0:1788582090.827106:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7165 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.827114:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7165 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.827145:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7165 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.827152:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7165 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.827159:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7165 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.827165:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582090.827170:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7165 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.827177:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7165 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.827188:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:1.0:1788582090.827190:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788582090.827194:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7165 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.827240:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7165 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582090.827298:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf433480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+12:10432:x1875464001988224:12345-192.168.201.12@tcp:55:lhsmtool_posix.0 Request processed in 5178us (5368us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788582090.827313:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 82 00000100:00100000:3.0:1788582090.832745:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582090.833109:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001988480 00000100:00100000:2.0:1788582090.833120:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001988480 00000100:00100000:2.0:1788582090.833181:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 32 00000100:00100000:2.0:1788582090.833192:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+7:2349:x1875464001988480:12345-192.168.201.12@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788582090.833271:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a716c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.833292:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002dc4f75b/0x2bc3aa892c3a7150 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91cd expref: 7 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.833300:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788582090.833305:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788582090.833309:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a716c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.833343:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002dc4f75b/0x2bc3aa892c3a7150 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91cd expref: 7 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.833358:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002dc4f75b/0x2bc3aa892c3a7150 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91cd expref: 7 pid: 8034 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582090.833396:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac141180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1875464020881024:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582090.833490:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8721c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788582090.848142:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582090.848233:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001988608 00000100:00100000:1.0:1788582090.848243:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001988608 00000100:00100000:3.0:1788582090.848263:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac141180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1875464020881024:192.168.201.12@tcp:104: 00010000:00010000:1.0:1788582090.848282:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002dc4f75b/0x2bc3aa892c3a7150 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91cd expref: 8 pid: 8034 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.848291:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a716c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582090.848324:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 44 00000100:00100000:1.0:1788582090.848333:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac142d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+8:2349:x1875464001988608:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788582090.848348:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582090.848369:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002dc4f75b/0x2bc3aa892c3a7150 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91cd expref: 8 pid: 8034 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.848382:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002dc4f75b/0x2bc3aa892c3a7150 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91cd expref: 8 pid: 8034 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.848416:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dc4f75b/0x2bc3aa892c3a7150 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91cd expref: 8 pid: 8034 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.848433:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788582090.848438:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788582090.848443:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a716c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.848460:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a716c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.848507:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788582090.848575:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac142d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+7:2349:x1875464001988608:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 242us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582090.848584:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 44 00010000:00010000:3.0:1788582090.848588:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a716c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.848597:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a716c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.848622:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a716c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.848630:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a716c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.848638:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a716c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.848645:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05200 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:3.0:1788582090.848650:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a716c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.848659:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a716c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.848672:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a716c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.848702:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a716c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582090.848754:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:2349:x1875464001988480:12345-192.168.201.12@tcp:1:lhsmtool_posix.0 Request processed in 15564us (16022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582090.848762:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 32 00000100:00100000:3.0:1788582090.854971:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582090.855149:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001988864 00000100:00100000:0.0:1788582090.855160:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001988864 00000100:00100000:0.0:1788582090.855248:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 83 00000100:00100000:0.0:1788582090.855259:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+12:10432:x1875464001988864:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788582090.855345:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7173 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.855363:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7173 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.855375:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7173 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.855661:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a717a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.855673:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a712d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91b8 expref: 13 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.855701:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a717a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.855736:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a712d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91b8 expref: 13 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.855749:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a712d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91b8 expref: 13 pid: 10137 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582090.855765:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875464020881152:192.168.201.12@tcp:104: 00000100:00100000:0.0:1788582090.855844:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c8381f540 going to sleep for 11 seconds 00000100:00100000:0.0:1788582090.865267:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582090.865377:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b36a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875464020881152:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582090.865409:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a717a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582090.865411:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001988992 00000100:00100000:1.0:1788582090.865429:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001988992 00010000:00010000:1.0:1788582090.865481:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a712d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91b8 expref: 14 pid: 10137 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582090.865798:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 45 00000100:00100000:1.0:1788582090.865810:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+14:2349:x1875464001988992:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788582090.865826:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582090.865834:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a712d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91b8 expref: 14 pid: 10137 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.865847:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a712d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91b8 expref: 14 pid: 10137 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.865870:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a712d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91b8 expref: 14 pid: 10137 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.865886:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:1.0:1788582090.865891:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a717a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.865901:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a717a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.865923:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a717a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.866004:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788582090.866084:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+13:2349:x1875464001988992:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 275us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582090.866092:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 45 00010000:00010000:2.0:1788582090.868166:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a717a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582090.868183:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a717a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788582090.868467:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:2.0:1788582090.868934:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1788582090.868983:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:2.0:1788582090.869380:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac140000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1875464020881280:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788582090.869656:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582090.869975:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8885ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1788582090.870104:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020881280 00000100:00100000:1.0:1788582090.870113:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020881280 00000100:00100000:1.0:1788582090.870361:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788582090.870373:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875464020881280:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788582090.870475:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac141500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5843:x1875464020881280:12345-0@lo:1000:mdt00_000.0 Request processed in 103us (1029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582090.870483:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788582090.871129:0:5843:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788582090.871135:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d0d85b34e00, transno 4294967303 00000100:00100000:3.0:1788582090.871150:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac140000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1875464020881280:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788582090.873176:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1788582090.873359:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1875464020881408:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788582090.873428:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582090.873479:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c8381fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788582090.873757:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020881408 00000100:00100000:2.0:1788582090.873766:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020881408 00000100:00100000:2.0:1788582090.873821:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788582090.873832:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5843:x1875464020881408:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788582090.874096:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1875464020881408:12345-0@lo:1000:mdt00_000.0 Request processed in 266us (666us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788582090.874104:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788582090.874317:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b34e00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1875464020881408:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788582090.874358:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a717a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.874371:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a717a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.874379:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a717a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.874385:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088a00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582090.874390:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a717a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.874406:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a717a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.874423:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d0d917bda00) 00010000:00010000:0.0:1788582090.874426:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788582090.874432:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a717a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.874439:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a717a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.875867:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a70a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.875882:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a70a8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.875890:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a70a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.875894:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582090.875898:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a70a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.875914:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a70a8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.875932:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:0.0:1788582090.875934:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788582090.875938:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a70a8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.875963:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a70a8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.875991:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7181 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.876006:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a70c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c919c expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.876016:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7181 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.876079:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a70c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c919c expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.876093:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a70c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c919c expref: 16 pid: 5845 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582090.876108:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b37480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875464020881536:192.168.201.12@tcp:104: 00000100:00100000:0.0:1788582090.876234:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c8381fb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788582090.879288:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582090.879608:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001989120 00000100:00100000:0.0:1788582090.879620:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001989120 00010000:00010000:0.0:1788582090.879802:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a70c4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c919c expref: 17 pid: 5845 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582090.879848:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 46 00000100:00100000:0.0:1788582090.879859:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac141c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99087a3-3c83-4416-b2b9-d522b9885111+17:2349:x1875464001989120:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788582090.879890:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582090.879897:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a70c4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c919c expref: 17 pid: 5845 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.879911:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a70c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c919c expref: 17 pid: 5845 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.879933:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:0.0:1788582090.879938:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7181 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.879948:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7181 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.879954:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7181 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582090.879973:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788582090.880038:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac141c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99087a3-3c83-4416-b2b9-d522b9885111+17:2349:x1875464001989120:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 180us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582090.880045:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 46 00010000:00010000:1.0:1788582090.880408:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a70c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c919c expref: 16 pid: 5845 timeout: 409 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582090.880424:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b37480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875464020881536:192.168.201.12@tcp:104: 00010000:00010000:1.0:1788582090.880457:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7181 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.880467:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7181 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.880473:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7181 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.880484:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7181 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.880498:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7181 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.880504:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7181 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.880510:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582090.880514:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7181 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.880521:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7181 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.880532:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:1.0:1788582090.880535:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582090.880538:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7181 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.880544:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7181 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.880554:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7173 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.880560:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7173 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.880565:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7173 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.880570:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089e00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582090.880580:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7173 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.880586:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7173 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.880595:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:1.0:1788582090.880598:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788582090.880601:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7173 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.880607:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7173 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582090.880849:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf430a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+15:10432:x1875464001988864:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 Request processed in 25590us (25888us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1788582090.880858:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 83 00000020:00080000:1.0:1788582090.880862:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788582090.881882:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788582090.881890:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788582090.882325:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788582090.882333:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788582090.884732:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582090.884822:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001989376 00000100:00100000:1.0:1788582090.884835:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001989376 00000100:00100000:1.0:1788582090.884900:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 20 00000100:00100000:1.0:1788582090.884912:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+15:10432:x1875464001989376:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1788582090.886688:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1788582090.886821:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1788582090.886884:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7188 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.886899:0:5847:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7188 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.886910:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7188 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.886926:0:5847:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7188 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.886933:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7188 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.886939:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7188 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582090.886964:0:5847:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788582090.887263:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788582090.887271:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7188 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.887278:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd800 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:3.0:1788582090.887283:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7188 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.887290:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7188 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.887303:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff8d0da2fafc00) 00010000:00010000:3.0:1788582090.887306:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788582090.887310:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7188 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.887325:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7188 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582090.887344:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582090.887346:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582090.887348:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582090.889466:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+17:10432:x1875464001989376:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 Request processed in 4534us (4722us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788582090.889480:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 20 00000020:00080000:1.0:1788582090.889488:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788582091.247758:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020881664:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788582091.247833:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582091.247917:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020881664 00000100:00100000:3.0:1788582091.247925:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020881664 00000100:00100000:3.0:1788582091.247974:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788582091.247983:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875464020881664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788582091.248008:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1788582091.248085:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1875464020881664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582091.248092:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788582091.248140:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf431880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020881664:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788582091.248646:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875464020882048:0@lo:400:kworker.0 00000100:00100000:0.0:1788582091.248683:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582091.248732:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788582091.248739:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875464020881920:0@lo:400:kworker.0 00000100:00100000:0.0:1788582091.248764:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582091.248903:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020882048 00000100:00100000:2.0:1788582091.248909:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020882048 00000100:00100000:2.0:1788582091.248959:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020881920 00000100:00100000:2.0:1788582091.248962:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020881920 00000100:00100000:2.0:1788582091.248980:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788582091.248987:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875464020882048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582091.249034:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875464020882048:12345-0@lo:400:kworker.0 Request processed in 48us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582091.249041:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788582091.249190:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788582091.249198:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875464020881920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582091.249251:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875464020881920:12345-0@lo:400:kworker.0 Request processed in 55us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582091.249257:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788582091.249302:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875464020881920:0@lo:400:kworker.0 00000100:00100000:2.0:1788582091.249312:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875464020882048:0@lo:400:kworker.0 00000100:00100000:1.0:1788582091.249512:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020882176:0@lo:400:kworker.0 00000100:00100000:1.0:1788582091.249549:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582091.249581:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788582091.249588:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020881792:0@lo:400:kworker.0 00000100:00100000:1.0:1788582091.249616:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582091.249643:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabc78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020882304:0@lo:400:kworker.0 00000100:00100000:1.0:1788582091.249663:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582091.249702:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020881792 00000100:00100000:1.0:1788582091.249707:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020881792 00000100:00100000:1.0:1788582091.249734:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788582091.249741:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020881792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582091.249779:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3333c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020881792:12345-0@lo:400:kworker.0 Request processed in 38us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582091.249800:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788582091.249835:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020881792:0@lo:400:kworker.0 00000100:00100000:1.0:1788582091.249850:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020882304 00000100:00100000:1.0:1788582091.249853:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020882304 00000100:00100000:1.0:1788582091.249875:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788582091.249881:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020882304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582091.249924:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab901f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020882304:12345-0@lo:400:kworker.0 Request processed in 44us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582091.249929:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788582091.249950:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabc78e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020882304:0@lo:400:kworker.0 00000100:00100000:2.0:1788582091.250236:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020882176 00000100:00100000:2.0:1788582091.250241:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020882176 00000100:00100000:2.0:1788582091.250282:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788582091.250291:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab903b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1875464020882176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582091.250331:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab903b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3308:x1875464020882176:12345-0@lo:400:kworker.0 Request processed in 41us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582091.250337:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788582091.250364:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020882176:0@lo:400:kworker.0 00000100:00080000:0.0:1788582091.250468:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788582091.501438:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788582092.348013:0:12053:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788582092.348025:0:12053:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788582092.348078:0:12053:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788582092.348084:0:12053:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788582092.464008:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582092.464116:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001989632 00000100:00100000:2.0:1788582092.464126:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001989632 00000100:00100000:2.0:1788582092.464221:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 84 00000100:00100000:2.0:1788582092.464242:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+17:10450:x1875464001989632:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:2.0:1788582092.464267:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582092.464287:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a718f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c91d4 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.464393:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05600/0x2bc3aa892c3a7196 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.464409:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05600/0x2bc3aa892c3a7196 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.464430:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05600/0x2bc3aa892c3a7196 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582092.464442:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788582092.464557:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a718f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91d4 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.464574:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05600/0x2bc3aa892c3a7196 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91d4 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.464583:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:2.0:1788582092.464586:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788582092.464601:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05600, rc 0) 00000100:00100000:2.0:1788582092.464655:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+19:10450:x1875464001989632:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 416us (657us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1788582092.464663:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 84 00000100:00080000:0.0:1788582092.464813:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788582092.468388:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582092.468533:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001989760 00000100:00100000:1.0:1788582092.468543:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001989760 00000100:00100000:1.0:1788582092.468590:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 85 00000100:00100000:1.0:1788582092.468600:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+19:10450:x1875464001989760:12345-192.168.201.12@tcp:34:lfs.0 00010000:00010000:1.0:1788582092.468674:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a71a4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.468690:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a71a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.468701:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a71a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.468716:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a71ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.468740:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a71ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.468747:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a71ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.468956:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a71b2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.468964:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a71b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.468970:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a71b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788582092.469007:0:10136:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a71b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.469019:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a71a4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.469025:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a71a4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.469032:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a71a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.469048:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fc000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582092.469053:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a71a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.469060:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a71a4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.469077:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:1.0:1788582092.469080:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582092.469085:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a71a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.469092:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a71a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.469104:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a71ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.469110:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a71ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.469115:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a71ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.469120:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582092.469123:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a71ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.469129:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a71ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.469136:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d0da2fafd00) 00010000:00010000:1.0:1788582092.469138:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582092.469141:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a71ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.469147:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a71ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.469171:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a71b2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.469178:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a71b2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.469184:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a71b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.469189:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fda00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582092.469193:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a71b2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.469199:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a71b2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.469225:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0da2fafc00) 00010000:00010000:1.0:1788582092.469228:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582092.469231:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a71b2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.469237:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a71b2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582092.469309:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+19:10450:x1875464001989760:12345-192.168.201.12@tcp:34:lfs.0 Request processed in 709us (939us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582092.469318:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 85 00010000:00010000:2.0:1788582092.525379:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582092.535636:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582092.536075:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001990016 00000100:00100000:3.0:1788582092.536086:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001990016 00000100:00100000:3.0:1788582092.536157:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 86 00000100:00100000:3.0:1788582092.536168:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+19:10453:x1875464001990016:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:3.0:1788582092.536192:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582092.536240:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a71b9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c91db expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.536337:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a71c0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.536354:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a71c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.536365:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a71c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.536390:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.536399:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.536406:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.536907:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a71ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.536917:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a71ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.536924:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a71ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582092.536933:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788582092.537025:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a71c0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.537042:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a71c0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.537057:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a71c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.537063:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582092.537067:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a71c0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.537075:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a71c0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.537088:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:3.0:1788582092.537091:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582092.537096:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a71c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.537102:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a71c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.537115:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.537122:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71c7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.537127:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.537132:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582092.537135:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.537154:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71c7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.537163:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d0d917bd200) 00010000:00010000:3.0:1788582092.537166:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582092.537169:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71c7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.537176:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.537352:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a71b9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91db expref: 22 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.537367:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a71ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91db expref: 21 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.537375:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:3.0:1788582092.537487:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788582092.537490:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26400, rc 0) 00000100:00100000:3.0:1788582092.537596:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+21:10453:x1875464001990016:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 1428us (1967us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788582092.537605:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 86 00000100:00100000:1.0:1788582092.548589:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582092.548693:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001990144 00000100:00100000:0.0:1788582092.548704:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001990144 00000100:00100000:0.0:1788582092.548763:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 87 00000100:00100000:0.0:1788582092.548774:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+21:10453:x1875464001990144:12345-192.168.201.12@tcp:54:lfs.0 00010000:00010000:0.0:1788582092.548841:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a71dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.548857:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a71dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.548869:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a71dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.548895:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a71dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.548902:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a71dc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.548908:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a71dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.548913:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582092.548917:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a71dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.548941:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a71dc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.548952:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:0.0:1788582092.548955:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788582092.548959:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a71dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.548965:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a71dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582092.549042:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+21:10453:x1875464001990144:12345-192.168.201.12@tcp:54:lfs.0 Request processed in 260us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582092.549051:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 87 00000100:00100000:3.0:1788582092.563802:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582092.563837:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001990400 00000100:00100000:3.0:1788582092.563847:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001990400 00000100:00100000:3.0:1788582092.563908:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 21 00000100:00100000:3.0:1788582092.563918:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d84f80050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+21:10453:x1875464001990400:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:3.0:1788582092.564188:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d84f80050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+22:10453:x1875464001990400:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 270us (392us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1788582092.564196:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 21 00000100:00100000:0.0:1788582092.644054:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582092.644334:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001990656 00000100:00100000:3.0:1788582092.644345:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001990656 00000100:00100000:3.0:1788582092.644466:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 88 00000100:00100000:3.0:1788582092.644476:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+22:9974:x1875464001990656:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:3.0:1788582092.644501:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582092.644521:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a71e3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c91e2 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.644620:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.644636:0:10137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a71ce lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91db expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.644645:0:10137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71ea lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.644684:0:10137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a71ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91db expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.644698:0:10137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a71ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91db expref: 23 pid: 5845 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582092.644712:0:10137:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf433800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10137:1875464020882432:192.168.201.12@tcp:104: 00000100:00100000:3.0:1788582092.644818:0:10137:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8721c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788582092.647500:0:10137:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf433800 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10137:1875464020882432:192.168.201.12@tcp:104: 00010000:00010000:0.0:1788582092.647531:0:10137:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582092.648149:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582092.648354:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001990784 00000100:00100000:3.0:1788582092.648362:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001990784 00010000:00010000:3.0:1788582092.648404:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a71ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91db expref: 24 pid: 5845 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582092.648444:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 47 00000100:00100000:3.0:1788582092.648453:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+24:2350:x1875464001990784:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582092.648467:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582092.648474:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a71ce lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91db expref: 24 pid: 5845 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.648485:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a71ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91db expref: 24 pid: 5845 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.648505:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a71ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91db expref: 24 pid: 5845 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.648519:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:3.0:1788582092.648523:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71ea lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.648532:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.648540:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71ea lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.648571:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582092.648628:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+23:2350:x1875464001990784:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 175us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582092.648636:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 47 00010000:00010000:2.0:1788582092.648735:0:10137:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.648743:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71ea lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582092.648762:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788582092.648890:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a71e3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91e2 expref: 24 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.648904:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91e2 expref: 23 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.648911:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:2.0:1788582092.648914:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788582092.648916:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27c00, rc 0) 00000100:00100000:2.0:1788582092.648942:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+23:9974:x1875464001990656:12345-192.168.201.12@tcp:101:bash.0 Request processed in 4468us (4910us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788582092.648949:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 88 00000100:00100000:3.0:1788582092.650910:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582092.651629:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001991040 00000100:00100000:0.0:1788582092.651639:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001991040 00000100:00100000:0.0:1788582092.651790:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 89 00000100:00100000:0.0:1788582092.651800:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+23:9974:x1875464001991040:12345-192.168.201.12@tcp:36:bash.0 00010000:00010000:0.0:1788582092.652083:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a71f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.652099:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a71f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.652121:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a71f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788582092.652168:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:0.0:1788582092.652189:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abfa1db6 reply state 00000000d6d3822a transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a71f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582092.652224:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1788582092.652266:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:0.0:1788582092.652365:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf430e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+27:9974:x1875464001991040:12345-192.168.201.12@tcp:36:bash.0 Request processed in 565us (1461us total) trans 4294967369 rc 0/0 00000100:00100000:0.0:1788582092.652372:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 89 00000020:00080000:0.0:1788582092.652479:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788582092.655569:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00010000:00010000:3.0:1788582092.655684:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a71f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.655696:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a71f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.655703:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a71f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.655710:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582092.655715:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a71f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.655722:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a71f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.655738:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:3.0:1788582092.655741:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582092.655745:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a71f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.655751:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a71f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582092.656008:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001991168 00000100:00100000:1.0:1788582092.656018:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001991168 00000100:00100000:1.0:1788582092.656127:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 90 00000100:00100000:1.0:1788582092.656138:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+26:9974:x1875464001991168:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:1.0:1788582092.656160:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582092.656180:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a71ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c91e9 expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.656270:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a71ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91e9 expref: 27 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.656282:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a71ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91e9 expref: 27 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.656299:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:1.0:1788582092.656302:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788582092.656304:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fd000, rc 0) 00000100:00100000:1.0:1788582092.656365:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb07b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+27:9974:x1875464001991168:12345-192.168.201.12@tcp:101:bash.0 Request processed in 229us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582092.656372:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 90 00000100:00100000:1.0:1788582092.659534:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582092.659942:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001991296 00000100:00100000:0.0:1788582092.659951:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001991296 00000100:00100000:0.0:1788582092.660065:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 33 00000100:00100000:0.0:1788582092.660076:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+6:9974:x1875464001991296:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:0.0:1788582092.660094:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582092.660115:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000630b5196/0x2bc3aa892c3a7206 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c91f0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788582092.660140:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9b98c9, atime: 0x6a9b98c7, ctime: 0x6a9b98c9, blocks: 0xb 00010000:00010000:0.0:1788582092.660161:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=311s v=(0 0) 00010000:00010000:0.0:1788582092.660166:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582092.660174:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000630b5196/0x2bc3aa892c3a7206 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91f0 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.660234:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000630b5196/0x2bc3aa892c3a7206 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91f0 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.660248:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7088600, rc 0) 00000100:00100000:0.0:1788582092.660303:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+7:9974:x1875464001991296:12345-192.168.201.12@tcp:101:bash.0 Request processed in 228us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582092.660311:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 33 00000100:00080000:3.0:1788582092.660936:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788582092.665850:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582092.665951:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001991424 00000100:00100000:2.0:1788582092.665962:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001991424 00002000:00010000:2.0:1788582092.666004:0:6696:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1788582092.666009:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0dbf432a00 with x1875464001991424 ext(0->18446744073709551615) 00002000:00010000:2.0:1788582092.666023:0:6696:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0dbf432a00. 00000100:00100000:2.0:1788582092.666129:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 1 00000100:00100000:2.0:1788582092.666140:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b99087a3-3c83-4416-b2b9-d522b9885111+7:2351:x1875464001991424:12345-192.168.201.12@tcp:10:bash.0 00002000:00010000:2.0:1788582092.666476:0:6696:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788582092.666480:0:6696:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1788582089 -> 1788582092 00002000:00010000:2.0:1788582092.666483:0:6696:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1788582087 -> 1788582087 00002000:00010000:2.0:1788582092.666485:0:6696:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1788582089 -> 1788582092 00002000:00010000:2.0:1788582092.666488:0:6696:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1788582092.666540:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b99087a3-3c83-4416-b2b9-d522b9885111+8:2351:x1875464001991424:12345-192.168.201.12@tcp:10:bash.0 Request processed in 401us (701us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788582092.666549:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 1 00002000:00010000:2.0:1788582092.666553:0:6696:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:2.0:1788582092.666556:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0dbf432a00 with x1875464001991424 ext(0->18446744073709551615) 00002000:00010000:2.0:1788582092.666561:0:6696:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0dbf432a00. 00000100:00100000:1.0:1788582092.747883:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582092.748040:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001991552 00000100:00100000:2.0:1788582092.748052:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001991552 00000100:00100000:2.0:1788582092.748154:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 91 00000100:00100000:2.0:1788582092.748166:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+27:10467:x1875464001991552:12345-192.168.201.12@tcp:34:lfs.0 00010000:00010000:2.0:1788582092.748281:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a720d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748297:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a720d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748309:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a720d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748388:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7214 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748410:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7214 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748418:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7214 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748629:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a721b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748638:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a721b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748646:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a721b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788582092.748693:0:10137:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a721b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748704:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a720d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748711:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a720d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748718:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a720d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748725:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582092.748729:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a720d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748737:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a720d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748755:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:2.0:1788582092.748758:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582092.748763:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a720d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748768:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a720d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748780:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7214 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748786:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7214 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748793:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7214 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748798:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04a00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582092.748801:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7214 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748811:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7214 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748819:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d0d85afc000) 00010000:00010000:2.0:1788582092.748822:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582092.748825:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7214 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748830:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7214 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748854:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a721b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748860:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a721b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748865:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a721b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748871:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582092.748874:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a721b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748880:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a721b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748887:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:2.0:1788582092.748889:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582092.748893:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a721b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.748898:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a721b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582092.749084:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+27:10467:x1875464001991552:12345-192.168.201.12@tcp:34:lfs.0 Request processed in 918us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582092.749093:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 91 00000100:00100000:1.0:1788582092.783021:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788582092.783057:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbfb04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020882560:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788582092.783130:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582092.783414:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020882560 00000100:00100000:3.0:1788582092.783428:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020882560 00000100:00100000:3.0:1788582092.783490:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788582092.783497:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875464020882560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788582092.783526:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788582092.783571:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875464020882560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 75us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582092.783576:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1788582092.783694:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788582092.783738:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbfb04700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020882560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788582092.810657:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582092.810745:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001991808 00000100:00100000:0.0:1788582092.810755:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001991808 00000100:00100000:0.0:1788582092.810829:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 92 00000100:00100000:0.0:1788582092.810840:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+27:10470:x1875464001991808:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:0.0:1788582092.810861:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582092.810881:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a7222 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c91f7 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.810947:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7229 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.810959:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7229 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.810968:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7229 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.810978:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a7230 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.810994:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a7230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.810998:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a7230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.812140:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7237 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.812152:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.812159:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7237 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582092.812167:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788582092.812257:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7229 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.812262:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7229 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.812267:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7229 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.812272:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088a00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582092.812276:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7229 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.812284:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7229 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.812308:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:0.0:1788582092.812311:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582092.812316:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7229 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.812323:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7229 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.812336:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a7230 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.812340:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a7230 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.812343:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a7230 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.812346:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582092.812348:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a7230 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.812351:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a7230 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.812356:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d0d888de100) 00010000:00010000:0.0:1788582092.812357:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582092.812359:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a7230 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.812363:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a7230 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.812405:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a7222 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91f7 expref: 30 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.812415:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7237 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91f7 expref: 29 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.812419:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:0.0:1788582092.812421:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788582092.812422:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7089e00, rc 0) 00000100:00100000:0.0:1788582092.812482:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+29:10470:x1875464001991808:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 1644us (1836us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1788582092.812487:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 92 00000100:00100000:1.0:1788582092.816261:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582092.816345:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001991936 00000100:00100000:2.0:1788582092.816355:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001991936 00000100:00100000:2.0:1788582092.816428:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 93 00000100:00100000:2.0:1788582092.816452:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+29:10470:x1875464001991936:12345-192.168.201.12@tcp:54:lfs.0 00010000:00010000:2.0:1788582092.816522:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7245 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.816539:0:10136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71ea lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91e2 expref: 29 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.816549:0:10136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7245 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.816584:0:10136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91e2 expref: 29 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.816598:0:10136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91e2 expref: 29 pid: 10137 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582092.816614:0:10136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac143100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10136:1875464020882688:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582092.816706:0:10136:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da337f480 going to sleep for 11 seconds 00000100:00100000:1.0:1788582092.818966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582092.819023:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001992192 00000100:00100000:0.0:1788582092.819043:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001992192 00000100:00100000:2.0:1788582092.819082:0:10136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac143100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10136:1875464020882688:192.168.201.12@tcp:104: 00000100:00100000:0.0:1788582092.819101:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 22 00000100:00100000:0.0:1788582092.819113:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+30:5586:x1875464001992192:12345-192.168.201.12@tcp:35:ldlm_bl.0 00010000:00010000:2.0:1788582092.819116:0:10136:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7245 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582092.819448:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+31:5586:x1875464001992192:12345-192.168.201.12@tcp:35:ldlm_bl.0 Request processed in 337us (490us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1788582092.819456:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 22 00000100:00100000:0.0:1788582092.821011:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582092.821440:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001992320 00000100:00100000:2.0:1788582092.821450:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001992320 00010000:00010000:2.0:1788582092.821486:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91e2 expref: 31 pid: 10137 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582092.821525:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 48 00000100:00100000:2.0:1788582092.821549:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99087a3-3c83-4416-b2b9-d522b9885111+31:2349:x1875464001992320:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788582092.821563:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582092.821570:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71ea lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91e2 expref: 31 pid: 10137 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.821584:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71ea lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91e2 expref: 31 pid: 10137 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.821607:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a71ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91e2 expref: 31 pid: 10137 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.821623:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:2.0:1788582092.821628:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7245 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.821638:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.821645:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7245 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.821923:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582092.821988:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99087a3-3c83-4416-b2b9-d522b9885111+30:2349:x1875464001992320:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 440us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582092.821996:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 48 00010000:00010000:1.0:1788582092.822852:0:10136:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.822874:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.822906:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7245 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.822913:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7245 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.822920:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7245 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.822926:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582092.822930:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7245 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.822937:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7245 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.822948:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:1.0:1788582092.822950:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788582092.822954:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7245 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.822961:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7245 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582092.823079:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+29:10470:x1875464001991936:12345-192.168.201.12@tcp:54:lfs.0 Request processed in 6626us (6825us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582092.823088:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 93 00000100:00100000:0.0:1788582092.825318:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582092.825377:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001992576 00000100:00100000:3.0:1788582092.825387:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001992576 00000100:00100000:3.0:1788582092.825449:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 23 00000100:00100000:3.0:1788582092.825461:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+29:10470:x1875464001992576:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:3.0:1788582092.828767:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+30:10470:x1875464001992576:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 3294us (3440us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788582092.828782:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 23 00000100:00100000:3.0:1788582092.897866:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582092.897940:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001992832 00000100:00100000:2.0:1788582092.897951:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001992832 00000100:00100000:2.0:1788582092.898094:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 94 00000100:00100000:2.0:1788582092.898106:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+30:10481:x1875464001992832:12345-192.168.201.12@tcp:101:cat.0 00010000:00010000:2.0:1788582092.898143:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582092.898164:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a724c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c91fe expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.898655:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7253 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.898679:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7253 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.898899:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7253 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.898917:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a725a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.898924:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a725a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.898932:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a725a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.901500:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7261 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.901519:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7261 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.901530:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7261 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582092.901542:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788582092.901670:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7253 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.901678:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7253 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.901685:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7253 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.901698:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582092.901703:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7253 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.901711:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7253 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.901725:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:2.0:1788582092.901728:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582092.901732:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7253 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.901739:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7253 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.901752:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a725a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.901759:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a725a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.901765:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a725a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.901781:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582092.901784:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a725a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.901790:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a725a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.901798:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d0d85afc000) 00010000:00010000:2.0:1788582092.901800:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582092.901803:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a725a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.901809:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a725a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.901860:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a724c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91fe expref: 33 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.901875:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7261 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91fe expref: 32 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.901881:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:2.0:1788582092.901883:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788582092.901886:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04e00, rc 0) 00000100:00100000:2.0:1788582092.902376:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+32:10481:x1875464001992832:12345-192.168.201.12@tcp:101:cat.0 Request processed in 4270us (4519us total) trans 4294967373 rc 0/0 00000100:00100000:2.0:1788582092.902387:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 94 00000040:00080000:2.0:1788582092.909465:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788582092.909487:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788582092.909524:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788582092.909532:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788582092.910359:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582092.918641:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001993088 00000100:00100000:0.0:1788582092.918664:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001993088 00000100:00100000:0.0:1788582092.918745:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 24 00000100:00100000:0.0:1788582092.918756:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+32:10481:x1875464001993088:12345-192.168.201.12@tcp:35:cat.0 00000100:00100000:0.0:1788582092.919133:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+33:10481:x1875464001993088:12345-192.168.201.12@tcp:35:cat.0 Request processed in 378us (8778us total) trans 4294967374 rc 0/0 00000100:00100000:0.0:1788582092.919141:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 24 00000100:00100000:0.0:1788582092.944153:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582092.944240:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001993344 00000100:00100000:3.0:1788582092.944251:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001993344 00000100:00100000:3.0:1788582092.944313:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 95 00000100:00100000:3.0:1788582092.944323:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+33:10482:x1875464001993344:12345-192.168.201.12@tcp:36:rm.0 00010000:00010000:3.0:1788582092.944400:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788582092.944421:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7261 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91fe expref: 33 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.944437:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7237 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91f7 expref: 32 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.944460:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a71ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91e9 expref: 31 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.944469:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:3.0:1788582092.944479:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788582092.944500:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a726f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.944524:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a726f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.944532:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a726f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.944542:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7276 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.944547:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.944553:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.944789:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a727d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.944795:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a727d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.944802:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a727d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788582092.946746:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1788582092.946822:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 311940618867ns, next at 312940615336ns, rc = 0 00010000:00010000:3.0:1788582092.946890:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7284 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.946903:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7284 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.946913:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7284 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.946920:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7284 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.947130:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7284 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.947139:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7284 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.947160:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788582092.947181:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a727d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.947185:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a727d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.947189:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a727d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.947193:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582092.947215:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a727d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.947221:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a727d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.947230:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bd800) 00010000:00010000:3.0:1788582092.947232:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788582092.947234:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a727d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.947238:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a727d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.947251:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a726f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.947255:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a726f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.947259:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a726f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.947261:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582092.947263:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a726f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.947341:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788582092.947346:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7284 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.947350:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26c00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582092.947352:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7284 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.947356:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7284 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.947363:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff8d0d917bd800) 00010000:00010000:1.0:1788582092.947364:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788582092.947366:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7284 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.947556:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7284 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.947571:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582092.947573:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582092.947574:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582092.947596:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a726f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.947601:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:3.0:1788582092.947603:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582092.947610:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a726f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582092.947613:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a726f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788582092.947621:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dbae683d reply state 0000000059cf4bc3 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582092.947627:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788582092.947873:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb06a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+32:10482:x1875464001993344:12345-192.168.201.12@tcp:36:rm.0 Request processed in 3548us (3727us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788582092.947883:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 95 00010000:00010000:2.0:1788582092.950420:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7276 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.950438:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7276 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.950447:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7276 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.950454:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582092.950458:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7276 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.950466:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7276 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.950484:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d0d917bd200) 00010000:00010000:2.0:1788582092.950487:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582092.950492:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7276 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.950499:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7276 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582092.988605:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582092.988693:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001993600 00000100:00100000:1.0:1788582092.988705:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001993600 00000100:00100000:1.0:1788582092.988773:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 96 00000100:00100000:1.0:1788582092.988785:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+31:10488:x1875464001993600:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:1.0:1788582092.988812:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582092.988833:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fce00/0x2bc3aa892c3a728b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9205 expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.988959:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a7292 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.988991:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a7292 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.989003:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a7292 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.989019:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7299 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.989041:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7299 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.989050:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7299 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788582092.989631:0:10136:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788582092.989795:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a72a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.989805:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a72a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.989812:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a72a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.989841:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a7292 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.989847:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a7292 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.989854:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a7292 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.989866:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582092.989870:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a7292 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.989877:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a7292 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.989890:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:1.0:1788582092.989892:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582092.989897:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a7292 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.989903:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a7292 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788582092.989915:0:10136:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f84a30b9 reply state 000000008a12559d transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7299 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582092.989923:0:10136:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788582092.989949:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fce00/0x2bc3aa892c3a728b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9205 expref: 34 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.989962:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a72a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9205 expref: 33 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.989970:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0da2fafd00) 00010000:00010000:1.0:1788582092.989972:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788582092.989974:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fc600, rc 0) 00000100:00100000:1.0:1788582092.990051:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb05f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+34:10488:x1875464001993600:12345-192.168.201.12@tcp:101:bash.0 Request processed in 1268us (1458us total) trans 4294967376 rc 0/0 00000100:00100000:1.0:1788582092.990064:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 96 00010000:00010000:1.0:1788582092.991845:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7299 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.991859:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7299 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.991867:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7299 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.991873:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fca00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582092.991877:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7299 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.991885:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7299 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.991900:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d0da2fafc00) 00010000:00010000:1.0:1788582092.991903:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582092.991907:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7299 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582092.991913:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7299 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582092.992806:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582092.993177:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001993728 00000100:00100000:2.0:1788582092.993188:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001993728 00000100:00100000:2.0:1788582092.993283:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 34 00000100:00100000:2.0:1788582092.993294:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+5:2350:x1875464001993728:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:2.0:1788582092.993327:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582092.993345:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a72ae lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c920c expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788582092.993354:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:2.0:1788582092.993367:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788582092.993384:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=311s v=(0 0) 00010000:00010000:2.0:1788582092.993388:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788582092.993394:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a72ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c920c expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.993406:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a72ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c920c expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582092.993415:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04a00, rc 0) 00000100:00100000:2.0:1788582092.993464:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+6:2350:x1875464001993728:12345-192.168.201.12@tcp:101:bash.0 Request processed in 173us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582092.993469:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 34 00000100:00100000:3.0:1788582092.997599:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582092.998055:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001993856 00000100:00100000:0.0:1788582092.998067:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001993856 00000100:00100000:0.0:1788582092.998134:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 35 00000100:00100000:0.0:1788582092.998146:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+6:10488:x1875464001993856:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:0.0:1788582092.998166:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582092.998185:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a72b5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9213 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582092.998261:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a72ae lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c920c expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.000156:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582093.000161:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582093.000172:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a72b5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9213 expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.000241:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a72ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c920c expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.004462:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a72ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c920c expref: 7 pid: 6692 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582093.004491:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbfb06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1875464020882816:192.168.201.12@tcp:104: 00000100:00100000:0.0:1788582093.004643:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c82b94480 going to sleep for 11 seconds 00000100:00100000:3.0:1788582093.009653:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582093.009719:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001993984 00000100:00100000:1.0:1788582093.009728:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001993984 00010000:00010000:1.0:1788582093.009771:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a72ae lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c920c expref: 8 pid: 6692 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582093.009907:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbfb06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1875464020882816:192.168.201.12@tcp:104: 00010000:00010000:0.0:1788582093.009932:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a72b5 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9213 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582093.009935:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 49 00000100:00100000:1.0:1788582093.009950:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da7244450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+8:2350:x1875464001993984:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788582093.009951:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7088000, rc 0) 00010000:00010000:1.0:1788582093.009969:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582093.009993:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a72ae lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c920c expref: 8 pid: 6692 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.010007:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a72ae lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c920c expref: 8 pid: 6692 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582093.010042:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf430000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+8:10488:x1875464001993856:12345-192.168.201.12@tcp:101:bash.0 Request processed in 11897us (12451us total) trans 0 rc 0/0 00010000:00010000:1.0:1788582093.010045:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a72ae lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c920c expref: 8 pid: 6692 timeout: 411 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582093.010056:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 35 00010000:00010000:1.0:1788582093.010065:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788582093.010071:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582093.010081:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a72b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9213 expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.010093:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a72b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9213 expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.010128:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a72b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9213 expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582093.010145:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbad3c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5828:1875464020882944:192.168.201.12@tcp:105: 00000100:00100000:1.0:1788582093.010832:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d909e73c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788582093.013871:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbad3c380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5828:1875464020882944:192.168.201.12@tcp:105: 00010000:00010000:1.0:1788582093.013890:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788582093.013941:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da7244450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:2350:x1875464001993984:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 3995us (4295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582093.013950:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 49 00000100:00100000:3.0:1788582093.014635:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582093.014707:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001994240 00000100:00100000:0.0:1788582093.014714:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001994240 00000100:00100000:0.0:1788582093.014794:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 25 00000100:00100000:0.0:1788582093.014804:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+33:10488:x1875464001994240:12345-192.168.201.12@tcp:35:bash.0 00000100:00100000:0.0:1788582093.015104:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+34:10488:x1875464001994240:12345-192.168.201.12@tcp:35:bash.0 Request processed in 301us (470us total) trans 4294967377 rc 0/0 00000100:00100000:0.0:1788582093.015112:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 25 00000100:00100000:3.0:1788582093.106986:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582093.107244:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001994368 00000100:00100000:2.0:1788582093.107257:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001994368 00000100:00100000:2.0:1788582093.107342:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 97 00000100:00100000:2.0:1788582093.107353:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+34:10504:x1875464001994368:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:2.0:1788582093.107377:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582093.107396:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a72bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c921a expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.107449:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a72c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.107470:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a72c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.107480:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a72c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582093.107509:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788582093.107512:0:10137:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788582093.107524:0:10137:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a72c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.107541:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a72bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c921a expref: 36 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.107553:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a72c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c921a expref: 35 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.107559:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:2.0:1788582093.107561:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788582093.107564:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05400, rc 0) 00000100:00100000:2.0:1788582093.107649:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf433800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+35:10504:x1875464001994368:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 299us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582093.107654:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 97 00000100:00100000:1.0:1788582093.112500:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582093.112570:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001994624 00000100:00100000:3.0:1788582093.112579:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001994624 00000100:00100000:3.0:1788582093.112649:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 98 00000100:00100000:3.0:1788582093.112657:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+35:10504:x1875464001994624:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:3.0:1788582093.112675:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582093.112691:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a72ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9221 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.112771:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a72d1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.112782:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a72a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9205 expref: 36 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.112802:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a72d1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.112839:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a72a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9205 expref: 36 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.112848:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a72a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9205 expref: 36 pid: 10136 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582093.112859:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbad09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875464020883072:192.168.201.12@tcp:104: 00000100:00100000:3.0:1788582093.112989:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8721c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788582093.118056:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582093.118086:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbad09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875464020883072:192.168.201.12@tcp:104: 00010000:00010000:0.0:1788582093.118391:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a72d1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582093.118449:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001994752 00000100:00100000:1.0:1788582093.118456:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001994752 00010000:00010000:1.0:1788582093.118490:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a72a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9205 expref: 37 pid: 10136 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582093.118525:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 50 00000100:00100000:1.0:1788582093.118535:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+37:2349:x1875464001994752:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788582093.118550:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582093.118558:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a72a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9205 expref: 37 pid: 10136 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.118570:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a72a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9205 expref: 37 pid: 10136 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.118591:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc600/0x2bc3aa892c3a72a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9205 expref: 37 pid: 10136 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.118606:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0da2fafd00) 00010000:00010000:1.0:1788582093.118611:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a72d1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.118640:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a72d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.118647:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a72d1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.118670:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788582093.118684:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a72d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.118690:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a72d1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582093.118709:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000100:00100000:1.0:1788582093.118734:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad0b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+36:2349:x1875464001994752:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 199us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582093.118742:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 50 00010000:00010000:0.0:1788582093.118832:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a72ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9221 expref: 37 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.118846:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a72d1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9221 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.118851:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0da2fafd00) 00010000:00010000:0.0:1788582093.118854:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788582093.118856:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26400, rc 0) 00000100:00100000:0.0:1788582093.118878:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+36:10504:x1875464001994624:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 6223us (6389us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1788582093.118882:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 98 00000100:00100000:1.0:1788582093.124159:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582093.124268:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001995008 00000100:00100000:2.0:1788582093.124279:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001995008 00000100:00100000:2.0:1788582093.124329:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 99 00000100:00100000:2.0:1788582093.124340:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+36:10504:x1875464001995008:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:2.0:1788582093.124364:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582093.124380:0:10136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788582093.124403:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a72d1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9221 expref: 36 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.124419:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0da2fafd00) 00010000:00010000:2.0:1788582093.124430:0:10136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788582093.124445:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a72df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9228 expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.124531:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a72e6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.124541:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a72e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.124547:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a72e6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582093.124556:0:10136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788582093.124663:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a72df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9228 expref: 38 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.124677:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a72e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9228 expref: 37 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.124686:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d85afc800) 00010000:00010000:2.0:1788582093.124688:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788582093.124691:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05800, rc 0) 00000100:00100000:2.0:1788582093.124753:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+37:10504:x1875464001995008:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 414us (604us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788582093.124770:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 99 00000100:00100000:3.0:1788582093.127745:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582093.127809:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001995136 00000100:00100000:2.0:1788582093.127817:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001995136 00000100:00100000:2.0:1788582093.127857:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 100 00000100:00100000:2.0:1788582093.127864:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+37:10504:x1875464001995136:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:2.0:1788582093.127885:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582093.127901:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a72f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c922f expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.127956:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a72f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c922f expref: 38 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.127970:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a72f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c922f expref: 38 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.127984:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d85afc800) 00010000:00010000:2.0:1788582093.127986:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788582093.127988:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05200, rc 0) 00000100:00100000:2.0:1788582093.128055:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+38:10504:x1875464001995136:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 190us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582093.128073:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 100 00000100:00100000:3.0:1788582093.131730:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582093.131786:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001995264 00000100:00100000:2.0:1788582093.131794:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001995264 00000100:00100000:2.0:1788582093.131836:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 36 00000100:00100000:2.0:1788582093.131842:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+6:2349:x1875464001995264:12345-192.168.201.12@tcp:1:lfs.0 00010000:00010000:2.0:1788582093.131879:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a72fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.131907:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a72b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9213 expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.131913:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788582093.131917:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788582093.131922:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a72fb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.131959:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a72b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9213 expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.131972:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a72b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9213 expref: 6 pid: 6693 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582093.131984:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac143100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1875464020883200:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582093.132095:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da337f480 going to sleep for 11 seconds 00000100:00100000:2.0:1788582093.133406:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac143100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1875464020883200:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582093.133434:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a72fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582093.136538:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582093.137015:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001995392 00000100:00100000:2.0:1788582093.137033:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001995392 00002000:00100000:2.0:1788582093.137089:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8d0dbad08380 x1875464001995392/t0(0) o4->b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp:694/0 lens 504/0 e 0 to 0 dl 1788582104 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788582093.137114:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0dbad08380 with x1875464001995392 ext(0->8) 00010000:00010000:2.0:1788582093.137122:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a72b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9213 expref: 7 pid: 6693 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.137136:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a72b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9213 expref: 7 pid: 6693 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788582093.137142:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d0dbad08380 00000100:00100000:2.0:1788582093.137177:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 1 00000100:00100000:2.0:1788582093.137186:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b99087a3-3c83-4416-b2b9-d522b9885111+7:2350:x1875464001995392:12345-192.168.201.12@tcp:4:lfs.0 00000100:00100000:2.0:1788582093.137630:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad08380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b99087a3-3c83-4416-b2b9-d522b9885111+9:2350:x1875464001995392:12345-192.168.201.12@tcp:4:lfs.0 Request processed in 444us (1100us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1788582093.137637:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 1 00002000:00100000:2.0:1788582093.137643:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff8d0dbad08380 x1875464001995392/t4294967302(0) o4->b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp:694/0 lens 504/448 e 0 to 0 dl 1788582104 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788582093.137649:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0dbad08380 with x1875464001995392 ext(0->8) 00010000:00010000:2.0:1788582093.137653:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a72b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9213 expref: 9 pid: 6693 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.137661:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a72b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9213 expref: 9 pid: 6693 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788582093.137666:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d0dbad08380 00000100:00100000:1.0:1788582093.140482:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582093.140996:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001995520 00000100:00100000:2.0:1788582093.141018:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001995520 00010000:00010000:2.0:1788582093.141066:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a72b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9213 expref: 9 pid: 6693 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582093.141144:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 51 00000100:00100000:2.0:1788582093.141154:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+9:2349:x1875464001995520:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788582093.141169:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788582093.141187:0:7636:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788582093.141189:0:7636:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788582092 00002000:00010000:2.0:1788582093.141192:0:7636:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788582092 00002000:00010000:2.0:1788582093.141193:0:7636:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788582092 00010000:00010000:2.0:1788582093.141198:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a72b5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9213 expref: 9 pid: 6693 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.141242:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a72b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9213 expref: 9 pid: 6693 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.141266:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a72b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9213 expref: 9 pid: 6693 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.141283:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788582093.141287:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788582093.141292:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a72fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.141300:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a72fb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.141344:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582093.141406:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+8:2349:x1875464001995520:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 253us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582093.141421:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 51 00010000:00010000:3.0:1788582093.141483:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a72fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.141490:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a72fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.141519:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a72fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.141528:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a72fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.141545:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a72fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.141552:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04600 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:3.0:1788582093.141556:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a72fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.141563:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a72fb lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.141574:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a72fb lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.141580:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a72fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582093.141625:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+7:2349:x1875464001995264:12345-192.168.201.12@tcp:1:lfs.0 Request processed in 9782us (9902us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582093.141632:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 36 00000100:00100000:3.0:1788582093.150240:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582093.150281:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001995776 00000100:00100000:0.0:1788582093.150290:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001995776 00000100:00100000:0.0:1788582093.150339:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 26 00000100:00100000:0.0:1788582093.150347:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d84f83450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+38:10504:x1875464001995776:12345-192.168.201.12@tcp:35:lfs.0 00000004:00010000:0.0:1788582093.150406:0:5847:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a72e6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9228 expref: 38 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788582093.150621:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1788582093.150666:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1788582093.150957:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1788582093.150995:0:5847:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7302 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.151007:0:5847:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a72f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c922f expref: 42 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.151014:0:5847:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7302 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.151068:0:5847:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a72f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c922f expref: 42 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.151080:0:5847:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a72f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c922f expref: 42 pid: 10137 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582093.151091:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbfb06d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1875464020883328:192.168.201.12@tcp:104: 00000100:00100000:0.0:1788582093.151169:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c82b94480 going to sleep for 11 seconds 00000100:00100000:0.0:1788582093.154242:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582093.154259:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbfb06d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5847:1875464020883328:192.168.201.12@tcp:104: 00010000:00010000:1.0:1788582093.154285:0:5847:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7302 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582093.154321:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001995904 00000100:00100000:2.0:1788582093.154329:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001995904 00010000:00010000:2.0:1788582093.154366:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a72f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c922f expref: 43 pid: 10137 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582093.154396:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 52 00000100:00100000:2.0:1788582093.154405:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99087a3-3c83-4416-b2b9-d522b9885111+43:2350:x1875464001995904:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788582093.154422:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582093.154428:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a72f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c922f expref: 43 pid: 10137 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.154440:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a72f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c922f expref: 43 pid: 10137 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.154460:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a72f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c922f expref: 43 pid: 10137 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.154474:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d85afc800) 00010000:00010000:2.0:1788582093.154479:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7302 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.154488:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7302 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.154507:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7302 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.154527:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788582093.154549:0:5847:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7302 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.154555:0:5847:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7302 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582093.154581:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb04000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99087a3-3c83-4416-b2b9-d522b9885111+42:2350:x1875464001995904:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 176us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582093.154587:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 52 00000001:00080000:1.0:1788582093.154673:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:1.0:1788582093.154859:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:1.0:1788582093.154936:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbad3d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1875464020883456:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788582093.154971:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582093.154998:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d909e7840 going to sleep for 11 seconds 00000100:00100000:2.0:1788582093.155007:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020883456 00000100:00100000:2.0:1788582093.155011:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020883456 00000100:00100000:2.0:1788582093.155049:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788582093.155057:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5847:x1875464020883456:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788582093.155129:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5847:x1875464020883456:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 72us (156us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582093.155135:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788582093.155196:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbad3d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1875464020883456:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788582093.155727:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1788582093.155776:0:5847:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbfb05500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1875464020883584:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788582093.155806:0:5847:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582093.155862:0:5847:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c82b94b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788582093.155893:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020883584 00000100:00100000:2.0:1788582093.155896:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020883584 00000100:00100000:2.0:1788582093.155922:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788582093.155930:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5847:x1875464020883584:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788582093.156097:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb05c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5847:x1875464020883584:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 168us (291us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788582093.156102:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788582093.156138:0:5847:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbfb05500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5847:1875464020883584:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788582093.156167:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1788582093.156190:0:5847:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7302 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.156259:0:5847:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7302 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.156265:0:5847:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7302 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.156269:0:5847:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088a00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582093.156272:0:5847:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7302 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.156277:0:5847:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7302 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.156288:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d85afc800) 00010000:00010000:0.0:1788582093.156290:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788582093.156292:0:5847:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7302 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.156296:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7302 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5847 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788582093.156471:0:5847:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788582093.156577:0:5847:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1788582093.156586:0:5847:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 312150382952ns, next at 313150381113ns, rc = 0 00000001:00080000:0.0:1788582093.156590:0:5847:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1788582093.156610:0:5847:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d85afc800) 00010000:00010000:0.0:1788582093.156617:0:5847:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788582093.156621:0:5847:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a72e6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9228 expref: 46 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582093.156701:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d84f83450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+45:10504:x1875464001995776:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 6354us (6498us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1788582093.156709:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 26 00000020:00080000:0.0:1788582093.156713:0:5847:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788582093.161649:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582093.161754:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001996032 00000100:00100000:3.0:1788582093.161765:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001996032 00000100:00100000:3.0:1788582093.161825:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 101 00000100:00100000:3.0:1788582093.161835:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+45:10504:x1875464001996032:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:3.0:1788582093.161858:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582093.161909:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7309 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9236 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.162088:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7309 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9236 expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.162104:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7309 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9236 expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.162192:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:3.0:1788582093.162195:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788582093.162199:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26200, rc 0) 00000100:00100000:3.0:1788582093.162292:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb04e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+46:10504:x1875464001996032:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 459us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582093.162301:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 101 00000100:00100000:1.0:1788582093.169256:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582093.169740:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001996288 00000100:00100000:0.0:1788582093.169751:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001996288 00000100:00100000:0.0:1788582093.169819:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 27 00000100:00100000:0.0:1788582093.169830:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+46:10504:x1875464001996288:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:0.0:1788582093.171015:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+47:10504:x1875464001996288:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 1182us (1811us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1788582093.171038:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 27 00000100:00100000:1.0:1788582093.265620:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582093.265712:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001996416 00000100:00100000:2.0:1788582093.265722:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001996416 00000100:00100000:2.0:1788582093.265780:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 102 00000100:00100000:2.0:1788582093.265790:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+47:10514:x1875464001996416:12345-192.168.201.12@tcp:34:lfs.0 00010000:00010000:2.0:1788582093.265867:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7310 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.265897:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7310 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.265908:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7310 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.265923:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7317 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.265930:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.265935:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266046:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a731e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266052:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a731e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266057:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a731e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788582093.266094:0:10136:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a731e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266103:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7310 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266107:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7310 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266119:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7310 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266123:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582093.266126:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7310 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266130:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7310 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266139:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:2.0:1788582093.266142:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582093.266146:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7310 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266152:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7310 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266165:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7317 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266170:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7317 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266176:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7317 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266180:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582093.266183:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7317 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266196:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7317 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266248:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d0d85afc500) 00010000:00010000:2.0:1788582093.266250:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582093.266254:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7317 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266261:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7317 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266280:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a731e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266287:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a731e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266292:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a731e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266297:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582093.266300:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a731e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266306:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a731e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266312:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:2.0:1788582093.266315:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582093.266318:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a731e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.266333:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a731e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582093.266415:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+47:10514:x1875464001996416:12345-192.168.201.12@tcp:34:lfs.0 Request processed in 626us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582093.266423:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 102 00000100:00100000:3.0:1788582093.309037:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582093.309074:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001996672 00000100:00100000:3.0:1788582093.309084:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001996672 00000100:00100000:3.0:1788582093.309136:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 103 00000100:00100000:3.0:1788582093.309147:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+47:10517:x1875464001996672:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:3.0:1788582093.309179:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582093.309219:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7325 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c923d expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.309295:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a732c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.309310:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a732c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.309332:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a732c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.309348:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7333 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.309355:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.309362:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.309641:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a733a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.309651:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a733a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.309659:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a733a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582093.309668:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788582093.309768:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a732c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.309776:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a732c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.309784:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a732c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.309854:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582093.309865:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a732c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.309874:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a732c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.309886:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:3.0:1788582093.309889:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582093.309894:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a732c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.309900:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a732c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.309914:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7333 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.309920:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7333 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.309926:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7333 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.309931:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27a00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582093.309933:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7333 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.309939:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7333 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.309945:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d0d917bdf00) 00010000:00010000:3.0:1788582093.309947:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582093.309958:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7333 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.309964:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7333 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.310002:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7325 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c923d expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.310015:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a733a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c923d expref: 49 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.310034:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:3.0:1788582093.310036:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788582093.310039:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26800, rc 0) 00000100:00100000:3.0:1788582093.310098:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad0a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+49:10517:x1875464001996672:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 952us (1078us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1788582093.310106:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 103 00000100:00100000:1.0:1788582093.320649:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582093.324422:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001996800 00000100:00100000:0.0:1788582093.324437:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001996800 00000100:00100000:0.0:1788582093.324501:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 104 00000100:00100000:0.0:1788582093.324512:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+49:10517:x1875464001996800:12345-192.168.201.12@tcp:54:lfs.0 00010000:00010000:0.0:1788582093.324591:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7348 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.324608:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.324621:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.324647:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7348 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.324662:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7348 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.324669:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.324674:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088a00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582093.324679:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7348 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.324687:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7348 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.324702:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:0.0:1788582093.324705:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788582093.324709:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7348 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.324715:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a7348 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582093.324792:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+49:10517:x1875464001996800:12345-192.168.201.12@tcp:54:lfs.0 Request processed in 281us (4151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582093.324800:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 104 00000100:00100000:1.0:1788582093.335040:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582093.335080:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001997056 00000100:00100000:1.0:1788582093.335090:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001997056 00000100:00100000:1.0:1788582093.335140:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 28 00000100:00100000:1.0:1788582093.335150:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+49:10517:x1875464001997056:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:1.0:1788582093.335376:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+50:10517:x1875464001997056:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 226us (357us total) trans 4294967391 rc 0/0 00000100:00100000:1.0:1788582093.335384:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 28 00000001:00080000:1.0:1788582093.355081:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:1.0:1788582093.355099:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:1.0:1788582093.355104:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1788582093.427289:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582093.427412:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001997312 00000100:00100000:2.0:1788582093.427424:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001997312 00000100:00100000:2.0:1788582093.427492:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 105 00000100:00100000:2.0:1788582093.427505:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+50:10527:x1875464001997312:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:2.0:1788582093.427538:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582093.427542:0:10136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788582093.427574:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a72c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c921a expref: 50 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.427597:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:2.0:1788582093.427604:0:10136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788582093.427618:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a734f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9244 expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.427719:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7356 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.427733:0:10136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a733a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c923d expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.427740:0:10136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7356 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.428144:0:10136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a733a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c923d expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.428160:0:10136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a733a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c923d expref: 50 pid: 5845 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582093.428173:0:10136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac143100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10136:1875464020883712:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582093.428355:0:10136:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8667b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788582093.432390:0:10136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac143100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10136:1875464020883712:192.168.201.12@tcp:104: 00000100:00100000:1.0:1788582093.432510:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00010000:00010000:2.0:1788582093.432665:0:10136:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7356 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582093.432730:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001997440 00000100:00100000:0.0:1788582093.432739:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001997440 00010000:00010000:0.0:1788582093.432787:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a733a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c923d expref: 51 pid: 5845 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582093.432845:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 53 00000100:00100000:0.0:1788582093.432855:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+51:2350:x1875464001997440:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788582093.432869:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582093.432876:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a733a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c923d expref: 51 pid: 5845 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.432897:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a733a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c923d expref: 51 pid: 5845 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.432921:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a733a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c923d expref: 51 pid: 5845 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.432939:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:0.0:1788582093.432956:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7356 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.432965:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7356 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.432972:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7356 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.432999:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788582093.433065:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+50:2350:x1875464001997440:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 211us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582093.433073:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 53 00010000:00010000:1.0:1788582093.433269:0:10136:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7356 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.433276:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7356 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582093.433298:0:10136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788582093.433462:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a734f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9244 expref: 51 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.433478:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7356 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9244 expref: 50 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.433486:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:1.0:1788582093.433495:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788582093.433497:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05000, rc 0) 00000100:00100000:1.0:1788582093.433534:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb07100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+50:10527:x1875464001997312:12345-192.168.201.12@tcp:101:bash.0 Request processed in 6033us (6261us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1788582093.433542:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 105 00000100:00100000:1.0:1788582093.441065:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582093.441238:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001997696 00000100:00100000:2.0:1788582093.441248:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001997696 00000100:00100000:2.0:1788582093.441302:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 106 00000100:00100000:2.0:1788582093.441313:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+50:10527:x1875464001997696:12345-192.168.201.12@tcp:36:bash.0 00010000:00010000:2.0:1788582093.441613:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7364 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.441632:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.441644:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788582093.441702:0:10137:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:2.0:1788582093.441728:0:10137:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001725ed31 reply state 00000000b73ac225 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582093.441743:0:10137:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788582093.441862:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+53:10527:x1875464001997696:12345-192.168.201.12@tcp:36:bash.0 Request processed in 549us (808us total) trans 4294967394 rc 0/0 00000100:00100000:2.0:1788582093.441870:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 106 00000020:00080000:2.0:1788582093.441876:0:10137:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788582093.444419:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7364 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.444434:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7364 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.444442:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7364 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.444448:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582093.444453:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7364 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.444461:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7364 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.444478:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:2.0:1788582093.444482:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582093.444487:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7364 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.444493:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7364 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582093.447114:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582093.447241:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001997824 00000100:00100000:3.0:1788582093.447251:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001997824 00000100:00100000:3.0:1788582093.447308:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 107 00000100:00100000:3.0:1788582093.447319:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+52:10527:x1875464001997824:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:3.0:1788582093.447343:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582093.447364:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a736b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c924b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.447459:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7372 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.447490:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7356 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9244 expref: 53 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.447499:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7372 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.447535:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7356 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9244 expref: 53 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.447547:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7356 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9244 expref: 53 pid: 10136 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582093.447560:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbad08a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875464020883840:192.168.201.12@tcp:104: 00000100:00100000:3.0:1788582093.447642:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85a33180 going to sleep for 11 seconds 00000100:00100000:1.0:1788582093.452181:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582093.452295:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001997952 00000100:00100000:2.0:1788582093.452319:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001997952 00010000:00010000:2.0:1788582093.452361:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7356 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9244 expref: 54 pid: 10136 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582093.452415:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 54 00000100:00100000:2.0:1788582093.452426:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+54:2350:x1875464001997952:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788582093.452440:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582093.452447:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7356 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9244 expref: 54 pid: 10136 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.452463:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7356 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9244 expref: 54 pid: 10136 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.452486:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:2.0:1788582093.452491:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7372 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.452501:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.452509:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7372 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.452528:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582093.452693:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+54:2350:x1875464001997952:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 267us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582093.452701:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 54 00010000:00010000:3.0:1788582093.454049:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7356 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9244 expref: 53 pid: 10136 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582093.454071:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbad08a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875464020883840:192.168.201.12@tcp:104: 00010000:00010000:3.0:1788582093.454097:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.454106:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.454111:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582093.454158:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788582093.454175:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788582093.454231:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7372 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.454266:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a736b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c924b expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.454281:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7372 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c924b expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.454289:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:3.0:1788582093.454292:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788582093.454296:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27a00, rc 0) 00000100:00100000:3.0:1788582093.454356:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+52:10527:x1875464001997824:12345-192.168.201.12@tcp:101:bash.0 Request processed in 7037us (7251us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582093.454373:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 107 00000100:00100000:1.0:1788582093.457544:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582093.457661:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001998208 00000100:00100000:0.0:1788582093.457685:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001998208 00000100:00100000:0.0:1788582093.457735:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 29 00000100:00100000:0.0:1788582093.457746:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+52:10527:x1875464001998208:12345-192.168.201.12@tcp:35:bash.0 00000100:00100000:0.0:1788582093.457979:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+53:10527:x1875464001998208:12345-192.168.201.12@tcp:35:bash.0 Request processed in 234us (444us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1788582093.457988:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 29 00000100:00100000:2.0:1788582093.524350:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582093.524465:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001998336 00000100:00100000:1.0:1788582093.524475:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001998336 00000100:00100000:1.0:1788582093.524574:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 108 00000100:00100000:1.0:1788582093.524586:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+53:10533:x1875464001998336:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:1.0:1788582093.524611:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582093.524630:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a7379 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9252 expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.524708:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7380 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.524722:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.524733:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582093.524767:0:10136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1788582093.524771:0:10136:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788582093.524787:0:10136:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7380 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.524933:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a7379 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9252 expref: 55 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.524954:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7380 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9252 expref: 54 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.524963:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:1.0:1788582093.524966:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788582093.524969:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fd800, rc 0) 00000100:00100000:1.0:1788582093.525041:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac143100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+54:10533:x1875464001998336:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 457us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582093.525048:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 108 00000100:00100000:2.0:1788582093.528141:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582093.528283:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001998464 00000100:00100000:0.0:1788582093.528292:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001998464 00000100:00100000:0.0:1788582093.528342:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 109 00000100:00100000:0.0:1788582093.528352:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+54:10533:x1875464001998464:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:0.0:1788582093.528370:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582093.528389:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a7387 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9259 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528444:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a738e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528458:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a738e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528470:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a738e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528484:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a7395 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528492:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a7395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528509:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a7395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528592:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a739c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528601:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a739c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528608:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a739c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582093.528637:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788582093.528641:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788582093.528749:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a739c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528762:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a739c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528770:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a738e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528777:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a738e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528783:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a738e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528849:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582093.528856:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a738e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528865:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a738e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528881:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:0.0:1788582093.528884:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582093.528888:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a738e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528894:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a738e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528907:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a7395 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528913:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a7395 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528919:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a7395 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528924:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582093.528927:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a7395 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528933:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a7395 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528939:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d0d888de100) 00010000:00010000:0.0:1788582093.528941:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582093.528943:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a7395 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528949:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a7395 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528983:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a7387 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9259 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.528995:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a739c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9259 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.529003:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:0.0:1788582093.529005:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788582093.529008:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7089c00, rc 0) 00000100:00100000:0.0:1788582093.529069:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac142680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+55:10533:x1875464001998464:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 718us (936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582093.529076:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 109 00000100:00100000:3.0:1788582093.531966:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582093.532077:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001998720 00000100:00100000:1.0:1788582093.532088:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001998720 00000100:00100000:1.0:1788582093.532144:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 110 00000100:00100000:1.0:1788582093.532154:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+55:10533:x1875464001998720:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:1.0:1788582093.532174:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582093.532192:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a73a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9260 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.532315:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a73aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.532328:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7372 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c924b expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.532336:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a739c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9259 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.532357:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a73aa lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.532398:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a739c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9259 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.532411:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a739c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9259 expref: 56 pid: 5843 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582093.532424:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbad3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875464020883968:192.168.201.12@tcp:104: 00010000:00010000:1.0:1788582093.532533:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7372 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c924b expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.532543:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7372 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c924b expref: 56 pid: 5844 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582093.532551:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875464020884096:192.168.201.12@tcp:104: 00000100:00100000:1.0:1788582093.532574:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d909e7240 going to sleep for 11 seconds 00000100:00100000:2.0:1788582093.533824:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582093.533940:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001998848 00000100:00100000:0.0:1788582093.533947:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001998848 00010000:00010000:0.0:1788582093.533978:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a739c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9259 expref: 57 pid: 5843 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582093.534012:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 55 00000100:00100000:0.0:1788582093.534031:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac143480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+57:2349:x1875464001998848:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788582093.534042:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582093.534049:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a739c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9259 expref: 57 pid: 5843 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.534062:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a739c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9259 expref: 57 pid: 5843 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.534097:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:0.0:1788582093.534102:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a73aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.534110:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a73aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.534116:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788582093.534155:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac143480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+57:2349:x1875464001998848:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 126us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582093.534162:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 55 00010000:00010000:1.0:1788582093.536457:0:5844:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.12@tcp) returned -22 from blocking AST (req@00000000cbdbcd91 x1875464020883968) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a739c lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9259 expref: 56 pid: 5843 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.536478:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a739c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9259 expref: 56 pid: 5843 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582093.536505:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbad3d880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875464020883968:192.168.201.12@tcp:104: 00000100:00100000:1.0:1788582093.536534:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702df80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875464020884096:192.168.201.12@tcp:104: 00010000:00010000:1.0:1788582093.536556:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:1.0:1788582093.536562:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a73aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.536570:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a73aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.536578:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a73aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582093.537842:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582093.538273:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001998976 00000100:00100000:1.0:1788582093.538281:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001998976 00010000:00010000:1.0:1788582093.538315:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7372 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c924b expref: 56 pid: 5844 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582093.538345:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 56 00000100:00100000:1.0:1788582093.538354:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da7245450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+56:2350:x1875464001998976:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788582093.538382:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582093.538388:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7372 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c924b expref: 56 pid: 5844 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.538409:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7372 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c924b expref: 56 pid: 5844 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.538431:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a7372 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c924b expref: 56 pid: 5844 timeout: 412 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.538461:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:1.0:1788582093.538466:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a73aa lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.538475:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a73aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.538483:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a73aa lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.538517:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788582093.538577:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da7245450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+55:2350:x1875464001998976:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 223us (739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582093.538585:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 56 00010000:00010000:3.0:1788582093.538719:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a73aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.538728:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a73aa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582093.538746:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788582093.538895:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a73a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9260 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.538909:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a73aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9260 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.538927:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:3.0:1788582093.538929:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788582093.538932:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fd200, rc 0) 00000100:00100000:3.0:1788582093.538958:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad08a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+55:10533:x1875464001998720:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 6805us (7001us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788582093.538965:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 110 00000100:00100000:3.0:1788582093.542931:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582093.543841:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001999232 00000100:00100000:0.0:1788582093.543852:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001999232 00000100:00100000:0.0:1788582093.543968:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 6 00000100:00100000:0.0:1788582093.543980:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+55:10533:x1875464001999232:12345-192.168.201.12@tcp:103:lfs.0 00010000:00010000:0.0:1788582093.543996:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582093.544031:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7309 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9236 expref: 55 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.544051:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:0.0:1788582093.544055:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788582093.544153:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad09880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+54:10533:x1875464001999232:12345-192.168.201.12@tcp:103:lfs.0 Request processed in 176us (1231us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582093.544161:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 6 00000100:00100000:2.0:1788582093.546559:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582093.546631:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001999360 00000100:00100000:1.0:1788582093.546641:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001999360 00000100:00100000:1.0:1788582093.546703:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 111 00000100:00100000:1.0:1788582093.546713:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+54:10533:x1875464001999360:12345-192.168.201.12@tcp:58:lfs.0 00010000:00010000:1.0:1788582093.546821:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a73b8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.546837:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a73b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.546847:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a73b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788582093.547349:0:10136:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1788582093.547541:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac143480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+54:10533:x1875464001999360:12345-192.168.201.12@tcp:58:lfs.0 Request processed in 828us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582093.547563:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 111 00000100:00100000:1.0:1788582093.550541:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582093.550610:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001999488 00000100:00100000:0.0:1788582093.550620:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001999488 00000100:00100000:0.0:1788582093.550694:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 112 00000100:00100000:0.0:1788582093.550705:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+54:10533:x1875464001999488:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:0.0:1788582093.550725:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582093.550744:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a73bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9267 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.550805:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a73b8 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.550816:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a73bf lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9267 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.550835:0:5843:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a73b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.550847:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a73bf lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9267 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.550860:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:0.0:1788582093.550863:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788582093.550866:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a73bf lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9267 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.550873:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7089000, rc 0) 00000100:00100000:0.0:1788582093.550933:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+55:10533:x1875464001999488:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 230us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582093.550939:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 112 00010000:00010000:1.0:1788582093.551329:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788582093.933623:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788582093.933633:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788582093.933690:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788582093.933697:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788582093.933830:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac142d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875464020884224:192.168.201.12@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788582093.933935:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8ab2af00 going to sleep for 11 seconds 00000100:00100000:1.0:1788582093.944026:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582093.945597:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac142d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875464020884224:192.168.201.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788582093.946141:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001999616 00000100:00100000:3.0:1788582093.946150:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001999616 00000100:00100000:3.0:1788582093.946242:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 113 00000100:00100000:3.0:1788582093.946253:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+55:10535:x1875464001999616:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788582093.946285:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788582093.946404:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+55:10535:x1875464001999616:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 Request processed in 144us (2397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582093.946412:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 113 00000100:00100000:3.0:1788582093.956270:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582093.956504:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464001999744 00000100:00100000:0.0:1788582093.956538:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464001999744 00000100:00100000:0.0:1788582093.956617:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 114 00000100:00100000:0.0:1788582093.956629:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+55:10535:x1875464001999744:12345-192.168.201.12@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788582093.956704:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a73c6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.956721:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a73c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.956744:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a73c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.956790:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a73cd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.956799:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a73cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.956806:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a73cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.956830:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a73d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.956838:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a73d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.956856:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a73d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582093.956894:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788582093.956900:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788582093.956918:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a73d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.956930:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a73c6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.956936:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a73c6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.956943:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a73c6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.956949:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582093.956954:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a73c6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.956961:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a73c6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.956974:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d0d888de500) 00010000:00010000:0.0:1788582093.956977:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582093.956982:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a73c6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.956988:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a73c6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.957000:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a73cd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.957006:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a73cd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.957022:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a73cd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.957036:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582093.957039:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a73cd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.957044:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a73cd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.957053:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff8d0d888de100) 00010000:00010000:0.0:1788582093.957055:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582093.957057:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a73cd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.957063:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a73cd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.957077:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a73d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.957082:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a73d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.957087:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a73d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.957092:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582093.957095:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a73d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.957101:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a73d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.957117:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:0.0:1788582093.957120:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582093.957122:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a73d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582093.957128:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a73d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582093.957225:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad0bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+55:10535:x1875464001999744:12345-192.168.201.12@tcp:34:lhsmtool_posix.0 Request processed in 576us (943us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582093.957234:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 114 00000100:00100000:3.0:1788582093.961997:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582093.962092:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002000000 00000100:00100000:2.0:1788582093.962102:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002000000 00000100:00100000:2.0:1788582093.962160:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 115 00000100:00100000:2.0:1788582093.962172:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+55:10535:x1875464002000000:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788582093.962193:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582093.962235:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a73db lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c926e expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.962329:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a73e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.962344:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a73e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.962355:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a73e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582093.962368:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1788582093.962481:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a73e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.962502:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a73e2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.962509:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a73e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.962515:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04e00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582093.962520:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a73e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.962528:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a73e2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.962543:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:2.0:1788582093.962546:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788582093.962551:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a73e2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.962557:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a73e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.962597:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a73db lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c926e expref: 57 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.962608:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d0d888de500) 00010000:00010000:2.0:1788582093.962611:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788582093.962614:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a73db lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c926e expref: 57 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582093.962646:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04800, rc 0) 00000100:00100000:2.0:1788582093.962719:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad08700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+56:10535:x1875464002000000:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 550us (733us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1788582093.962728:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 115 00000100:00100000:1.0:1788582093.968153:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582093.968254:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002000128 00000100:00100000:2.0:1788582093.968264:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002000128 00000100:00100000:2.0:1788582093.968323:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 116 00000100:00100000:2.0:1788582093.968343:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+56:10535:x1875464002000128:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788582093.968379:0:10136:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788582093.968496:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+56:10535:x1875464002000128:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 Request processed in 147us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582093.968503:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 116 00000100:00100000:0.0:1788582093.983243:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582093.983921:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002000384 00000100:00100000:3.0:1788582093.983934:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002000384 00000100:00100000:3.0:1788582093.984017:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 117 00000100:00100000:3.0:1788582093.984029:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+56:10535:x1875464002000384:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788582093.984050:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582093.984053:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788582093.984081:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7380 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9252 expref: 56 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.984120:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:3.0:1788582093.984125:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788582093.984141:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a73f0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9275 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788582093.985033:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1788582093.985263:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a73f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.985276:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a73f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.985285:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a73f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.985336:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a73f0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9275 expref: 58 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.985352:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a73f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9275 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582093.985359:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d0d917bd700) 00010000:00010000:3.0:1788582093.985362:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788582093.985364:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27800, rc 0) 00000100:00100000:3.0:1788582093.985436:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb06680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+57:10535:x1875464002000384:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 1409us (2203us total) trans 4294967398 rc 0/0 00000100:00100000:3.0:1788582093.985446:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 117 00000100:00100000:3.0:1788582093.989836:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582093.990050:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002000640 00000100:00100000:1.0:1788582093.990061:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002000640 00000100:00100000:1.0:1788582093.990124:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 118 00000100:00100000:1.0:1788582093.990136:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+57:10535:x1875464002000640:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788582093.990197:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582093.990251:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a73f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9275 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.990270:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d0d917bd700) 00010000:00010000:1.0:1788582093.990281:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788582093.990301:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a7405 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.990315:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a7405 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.990325:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a7405 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.990375:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a740c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x5670b1f4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.990382:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a740c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5670b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.990404:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a740c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5670b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.990468:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a7405 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.990476:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a7405 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.990482:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a7405 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.990596:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fde00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582093.990601:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a7405 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.990609:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a7405 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.990626:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:1.0:1788582093.990629:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582093.990633:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a7405 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.990639:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a7405 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.990648:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a740c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x5670b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.990766:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a740c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5670b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.990780:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a740c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5670b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.990784:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fda00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582093.990787:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a740c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5670b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.990794:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a740c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x5670b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.990802:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x5670b1f4 (ffff8d0da2fafa00) 00010000:00010000:1.0:1788582093.990805:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582093.990808:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a740c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5670b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582093.990812:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a740c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x5670b1f4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582093.991083:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad0b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+56:10535:x1875464002000640:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 Request processed in 946us (1255us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788582093.991092:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 118 00000100:00100000:3.0:1788582094.010604:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582094.010719:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002000768 00000100:00100000:2.0:1788582094.010729:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002000768 00000100:00100000:2.0:1788582094.010803:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 119 00000100:00100000:2.0:1788582094.010815:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+56:10535:x1875464002000768:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00000100:00080000:0.0:1788582094.010823:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788582094.010835:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582094.010859:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7413 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c927c expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.010893:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a741a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.010908:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a741a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.010939:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a741a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.011046:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7413 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c927c expref: 58 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.011060:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a741a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c927c expref: 57 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.011068:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d0d85afc500) 00010000:00010000:2.0:1788582094.011071:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788582094.011074:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04e00, rc 0) 00000100:00100000:2.0:1788582094.011134:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad08e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+57:10535:x1875464002000768:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 322us (541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582094.011142:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 119 00000100:00100000:3.0:1788582094.015991:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582094.016084:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002001024 00000100:00100000:2.0:1788582094.016095:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002001024 00000100:00100000:2.0:1788582094.016153:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 120 00000100:00100000:2.0:1788582094.016162:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+57:10535:x1875464002001024:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788582094.016259:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7421 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.016276:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.016285:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788582094.016519:0:10137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:2.0:1788582094.016526:0:10137:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 313010323658ns, next at 314010321934ns, rc = 0 00000004:00010000:2.0:1788582094.016599:0:10137:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b5e884ec reply state 00000000ec59d2c1 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582094.016608:0:10137:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788582094.016717:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad0aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+59:10535:x1875464002001024:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 Request processed in 555us (734us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1788582094.016724:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 120 00000100:00100000:0.0:1788582094.018680:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582094.018768:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002001152 00000100:00100000:3.0:1788582094.018777:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002001152 00000100:00100000:3.0:1788582094.018827:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 121 00000100:00100000:3.0:1788582094.018836:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+59:10535:x1875464002001152:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788582094.018858:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582094.018875:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7428 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9283 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.018926:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7428 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9283 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.018939:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7428 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9283 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.018957:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d0d85afc500) 00010000:00010000:3.0:1788582094.018960:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788582094.018964:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27400, rc 0) 00000100:00100000:3.0:1788582094.019025:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb07480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+60:10535:x1875464002001152:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 188us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582094.019032:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 121 00010000:00010000:1.0:1788582094.019644:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7421 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.019655:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7421 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.019884:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7421 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.019903:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04a00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582094.019907:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7421 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.019914:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7421 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.019927:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d0d85afc500) 00010000:00010000:1.0:1788582094.019930:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788582094.019934:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7421 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.019939:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7421 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582094.020348:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582094.020431:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002001280 00000100:00100000:2.0:1788582094.020438:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002001280 00000100:00100000:2.0:1788582094.020488:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 37 00000100:00100000:2.0:1788582094.020498:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+8:2349:x1875464002001280:12345-192.168.201.12@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788582094.020774:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+9:2349:x1875464002001280:12345-192.168.201.12@tcp:2:lhsmtool_posix.0 Request processed in 277us (426us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788582094.020782:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 37 00000100:00080000:0.0:1788582094.020927:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788582094.028075:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582094.028626:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002001536 00000100:00100000:1.0:1788582094.028636:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002001536 00000100:00100000:1.0:1788582094.028718:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 30 00000100:00100000:1.0:1788582094.028731:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+59:10535:x1875464002001536:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788582094.028996:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+60:10535:x1875464002001536:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 Request processed in 267us (927us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788582094.029006:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 30 00000100:00100000:1.0:1788582094.030691:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582094.031476:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002001792 00000100:00100000:3.0:1788582094.031487:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002001792 00000100:00100000:3.0:1788582094.031545:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 122 00000100:00100000:3.0:1788582094.031555:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+60:10535:x1875464002001792:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788582094.031678:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+60:10535:x1875464002001792:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 Request processed in 123us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582094.031687:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 122 00000100:00100000:3.0:1788582094.034993:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582094.036350:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002001920 00000100:00100000:0.0:1788582094.036364:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002001920 00000100:00100000:0.0:1788582094.036427:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 123 00000100:00100000:0.0:1788582094.036438:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+60:10535:x1875464002001920:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788582094.036460:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582094.036481:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a742f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c928a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582094.036580:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7436 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582094.036596:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582094.036615:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582094.036652:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788582094.036672:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7436 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582094.036699:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a742f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c928a expref: 62 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582094.036717:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7436 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c928a expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582094.036725:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d0d85afc500) 00010000:00010000:0.0:1788582094.036728:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788582094.036732:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7088000, rc 0) 00000100:00100000:0.0:1788582094.036854:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad09180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+61:10535:x1875464002001920:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 417us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582094.036862:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 123 00000100:00100000:0.0:1788582094.039695:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582094.039780:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002002048 00000100:00100000:1.0:1788582094.039799:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002002048 00000100:00100000:1.0:1788582094.039854:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 38 00000100:00100000:1.0:1788582094.039865:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+9:2350:x1875464002002048:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788582094.039900:0:8034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582094.039921:0:8034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003aa99c53/0x2bc3aa892c3a743d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9291 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788582094.039950:0:8034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b98cd, blocks: 0x1 00010000:00010000:1.0:1788582094.039968:0:8034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=313s v=(0 0) 00010000:00010000:1.0:1788582094.039972:0:8034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582094.039981:0:8034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003aa99c53/0x2bc3aa892c3a743d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9291 expref: 10 pid: 8034 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.040000:0:8034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003aa99c53/0x2bc3aa892c3a743d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9291 expref: 10 pid: 8034 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.040026:0:8034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fc000, rc 0) 00000100:00100000:1.0:1788582094.040088:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb06300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+10:2350:x1875464002002048:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 224us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582094.040095:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 38 00000100:00100000:1.0:1788582094.042513:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582094.042588:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002002304 00000100:00100000:2.0:1788582094.042597:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002002304 00000100:00100000:2.0:1788582094.042653:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 124 00000100:00100000:2.0:1788582094.042663:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+61:10535:x1875464002002304:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788582094.042759:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+61:10535:x1875464002002304:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 Request processed in 99us (255us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582094.042765:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 124 00000100:00100000:3.0:1788582094.044302:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582094.044530:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002002432 00000100:00100000:2.0:1788582094.044539:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002002432 00000100:00100000:2.0:1788582094.044606:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 39 00000100:00100000:2.0:1788582094.044616:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+10:10535:x1875464002002432:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788582094.044634:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582094.044654:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a7444 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9298 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.044684:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003aa99c53/0x2bc3aa892c3a743d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9291 expref: 11 pid: 8034 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.044694:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788582094.044699:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788582094.044703:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a7444 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9298 expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.044742:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003aa99c53/0x2bc3aa892c3a743d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9291 expref: 11 pid: 8034 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.044756:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003aa99c53/0x2bc3aa892c3a743d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9291 expref: 11 pid: 8034 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582094.044770:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac142d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1875464020884352:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582094.044865:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8667bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788582094.047344:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac142d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1875464020884352:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582094.047404:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a7444 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9298 expref: 11 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.047442:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04800, rc 0) 00000100:00100000:2.0:1788582094.047491:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad0ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+11:10535:x1875464002002432:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 2877us (3197us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582094.047500:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 39 00000100:00100000:1.0:1788582094.048830:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582094.048961:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002002560 00000100:00100000:2.0:1788582094.048972:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002002560 00010000:00010000:2.0:1788582094.049023:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003aa99c53/0x2bc3aa892c3a743d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9291 expref: 11 pid: 8034 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582094.049068:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 57 00000100:00100000:2.0:1788582094.049078:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+11:2349:x1875464002002560:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788582094.049092:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582094.049115:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003aa99c53/0x2bc3aa892c3a743d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9291 expref: 11 pid: 8034 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.049129:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003aa99c53/0x2bc3aa892c3a743d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9291 expref: 11 pid: 8034 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.049151:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003aa99c53/0x2bc3aa892c3a743d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9291 expref: 11 pid: 8034 timeout: 413 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.049167:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788582094.049171:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788582094.049179:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a7444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9298 expref: 10 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.049199:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a7444 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9298 expref: 10 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.049291:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a7444 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9298 expref: 10 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582094.049306:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac142d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5829:1875464020884480:192.168.201.12@tcp:105: 00000100:00100000:2.0:1788582094.049559:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8667bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788582094.052104:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac142d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5829:1875464020884480:192.168.201.12@tcp:105: 00010000:00010000:2.0:1788582094.052131:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582094.052193:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+10:2349:x1875464002002560:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 3115us (3369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582094.052228:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 57 00000100:00100000:1.0:1788582094.056952:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582094.057076:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002002688 00000100:00100000:2.0:1788582094.057089:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002002688 00002000:00100000:2.0:1788582094.057145:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8d0dac0c2a00 x1875464002002688/t0(0) o4->b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp:695/0 lens 504/0 e 0 to 0 dl 1788582105 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788582094.057156:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0dac0c2a00 with x1875464002002688 ext(0->12) 00002000:00010000:2.0:1788582094.057163:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0dac0c2a00 00000100:00100000:2.0:1788582094.057248:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 2 00000100:00100000:2.0:1788582094.057260:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b99087a3-3c83-4416-b2b9-d522b9885111+10:2350:x1875464002002688:12345-192.168.201.12@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788582094.057909:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b99087a3-3c83-4416-b2b9-d522b9885111+12:2350:x1875464002002688:12345-192.168.201.12@tcp:4:lhsmtool_posix.0 Request processed in 650us (964us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788582094.057925:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 2 00002000:00100000:2.0:1788582094.057933:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff8d0dac0c2a00 x1875464002002688/t4294967308(0) o4->b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp:695/0 lens 504/448 e 0 to 0 dl 1788582105 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788582094.057941:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0dac0c2a00 with x1875464002002688 ext(0->12) 00002000:00010000:2.0:1788582094.057945:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0dac0c2a00 00000100:00100000:3.0:1788582094.062335:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582094.062569:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002002816 00000100:00100000:2.0:1788582094.062580:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002002816 00000100:00100000:2.0:1788582094.062642:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 125 00000100:00100000:2.0:1788582094.062652:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+61:10535:x1875464002002816:12345-192.168.201.12@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788582094.092028:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967395 is committed 00000004:00080000:3.0:1788582094.092047:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1788582094.092066:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d0c82b940c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788582094.092072:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d0dbf902b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d0c82b94900 00000020:00080000:3.0:1788582094.092075:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d0dbf902000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d0dbad0dc00 00000020:00080000:3.0:1788582094.092233:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1788582094.092249:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbad09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020884608:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788582094.092320:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582094.092386:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020884608 00000100:00100000:3.0:1788582094.092503:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020884608 00000100:00100000:3.0:1788582094.092610:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788582094.092622:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020884608:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788582094.092647:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:3.0:1788582094.092676:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a9b98cc, atime: 0x6a9b98cc, ctime: 0x6a9b98cc, blocks: 0xb 00010000:00010000:3.0:1788582094.092684:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006514b1a3/0x2bc3aa892c3a744b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.092699:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=313s v=(0 0) 00010000:00010000:3.0:1788582094.092703:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582094.092726:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006514b1a3/0x2bc3aa892c3a744b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.092742:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006514b1a3/0x2bc3aa892c3a744b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.092752:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006514b1a3/0x2bc3aa892c3a744b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.092760:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006514b1a3/0x2bc3aa892c3a744b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.092776:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788582094.093339:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad0b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875464020884608:12345-0@lo:6:osp-syn-0-0.0 Request processed in 718us (1017us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788582094.093348:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788582094.093525:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1788582094.093531:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:3.0:1788582094.093547:0:3307:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d0dbbc58000, transno 4294967301 00000004:00080000:3.0:1788582094.093555:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:3.0:1788582094.093567:0:3307:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8d0dbad09500 x1875464020884608/t4294967304(4294967304) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788582110 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788582094.093578:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d0dbad09500/2, rc 0, transno 4294967304 00000100:00100000:3.0:1788582094.093583:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbad09500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020884608:0@lo:6:osp-syn-0-0.0 00000100:00080000:2.0:1788582094.093938:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788582094.093950:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582094.093959:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006514b1a3/0x2bc3aa892c3a744b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.093969:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27200 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582094.093973:0:7637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006514b1a3/0x2bc3aa892c3a744b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.093982:0:7637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006514b1a3/0x2bc3aa892c3a744b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.094000:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006514b1a3/0x2bc3aa892c3a744b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.094018:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006514b1a3/0x2bc3aa892c3a744b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.094045:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582094.094047:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582094.094049:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788582094.094098:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1788582094.094126:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:3.0:1788582094.094224:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:1.0:1788582094.094584:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad08000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+19:10535:x1875464002002816:12345-192.168.201.12@tcp:44:lhsmtool_posix.0 Request processed in 31930us (32256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582094.094594:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 125 00000100:00100000:0.0:1788582094.095089:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbfb05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020884864:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788582094.095136:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582094.095164:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788582094.095175:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbfb04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020884736:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788582094.095194:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582094.095242:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020884864 00000100:00100000:0.0:1788582094.095248:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020884864 00000100:00100000:0.0:1788582094.095298:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020884736 00000100:00100000:0.0:1788582094.095302:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020884736 00000100:00100000:0.0:1788582094.095322:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788582094.095330:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1875464020884864:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788582094.095629:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788582094.095632:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788582093 00002000:00010000:0.0:1788582094.095635:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788582094.095637:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788582093 -> 1788582093 00002000:00010000:0.0:1788582094.095639:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788582094.095711:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3309:x1875464020884864:12345-0@lo:2:osp-syn-1-0.0 Request processed in 382us (574us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788582094.095720:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788582094.095733:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788582094.095740:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1875464020884736:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788582094.095761:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:0.0:1788582094.095779:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7452 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582094.095797:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000630b5196/0x2bc3aa892c3a7206 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91f0 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582094.095806:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788582094.095810:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788582094.095814:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7452 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582094.095841:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000630b5196/0x2bc3aa892c3a7206 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91f0 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582094.095863:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000630b5196/0x2bc3aa892c3a7206 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91f0 expref: 11 pid: 6693 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582094.095875:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbfb06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1875464020884992:192.168.201.12@tcp:104: 00000100:00100000:0.0:1788582094.095926:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d866ec180 going to sleep for 11 seconds 00000100:00080000:0.0:1788582094.095937:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:3.0:1788582094.096507:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d0da791de40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788582094.096513:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d0dbaf19000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d0da791d6c0 00000020:00080000:3.0:1788582094.096516:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d0dbaf19200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d0da328b800 00000020:00080000:3.0:1788582094.096537:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1788582094.096715:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1788582094.096884:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1788582094.097274:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582094.097349:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002002944 00000100:00100000:1.0:1788582094.097378:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002002944 00000100:00100000:1.0:1788582094.097434:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 43 00000100:00100000:1.0:1788582094.097444:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+12:2349:x1875464002002944:12345-192.168.201.12@tcp:16:lhsmtool_posix.0 00000004:00080000:2.0:1788582094.103495:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d0dbfb05880/2, rc 0, transno 4294967309 00000100:00100000:2.0:1788582094.103512:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbfb05880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020884864:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788582094.103597:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582094.103624:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002003072 00000100:00100000:2.0:1788582094.103630:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002003072 00000100:00100000:0.0:1788582094.103745:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbfb06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1875464020884992:192.168.201.12@tcp:104: 00010000:00010000:0.0:1788582094.103767:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7452 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.104287:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000630b5196/0x2bc3aa892c3a7206 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91f0 expref: 13 pid: 6693 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582094.104385:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 58 00000100:00100000:2.0:1788582094.104396:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac142d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+13:2350:x1875464002003072:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788582094.104411:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582094.104418:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000630b5196/0x2bc3aa892c3a7206 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91f0 expref: 13 pid: 6693 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.104431:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000630b5196/0x2bc3aa892c3a7206 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91f0 expref: 13 pid: 6693 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.104454:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000630b5196/0x2bc3aa892c3a7206 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91f0 expref: 13 pid: 6693 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.104468:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788582094.104481:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788582094.104487:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7452 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.104497:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7452 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.104527:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788582094.104575:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7452 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582094.104578:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac142d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+12:2350:x1875464002003072:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 184us (982us total) trans 0 rc 0/0 00010000:00010000:0.0:1788582094.104585:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7452 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582094.104586:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 58 00010000:00010000:0.0:1788582094.104594:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7452 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582094.104601:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7452 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582094.104623:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788582094.105032:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582094.105040:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7452 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.105048:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088400 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582094.105052:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7452 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.105061:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7452 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.105072:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7452 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.105078:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7452 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.105105:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582094.105107:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582094.105108:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582094.105114:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb04000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3309:x1875464020884736:12345-0@lo:6:osp-syn-1-0.0 Request processed in 9373us (9916us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788582094.105128:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:2.0:1788582094.105275:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d0dbfb04a80/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788582094.105283:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbfb04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020884736:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1788582094.128227:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:0.0:1788582094.128367:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1788582094.128699:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad09c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+6:2349:x1875464002002944:12345-192.168.201.12@tcp:16:lhsmtool_posix.0 Request processed in 31250us (31421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582094.128712:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 43 00000100:00100000:2.0:1788582094.130646:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582094.130979:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002003328 00000100:00100000:0.0:1788582094.130990:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002003328 00000100:00100000:0.0:1788582094.131099:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 126 00000100:00100000:0.0:1788582094.131109:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+15:10535:x1875464002003328:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788582094.131167:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582094.131195:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7436 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c928a expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582094.131255:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d0d85afc500) 00010000:00010000:0.0:1788582094.131261:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788582094.131294:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7459 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582094.131317:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7459 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582094.131329:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7459 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788582094.131725:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000331fc5b9 reply state 00000000c1b94f21 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7459 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582094.131736:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788582094.131838:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac141c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+16:10535:x1875464002003328:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 Request processed in 729us (1200us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1788582094.131845:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 126 00010000:00010000:2.0:1788582094.133296:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7459 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.133322:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7459 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.133329:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7459 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.133335:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582094.133340:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7459 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.133348:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7459 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.133372:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d0d85afc500) 00010000:00010000:2.0:1788582094.133375:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582094.133379:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7459 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.133384:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7459 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582094.134036:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582094.134298:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002003456 00000100:00100000:3.0:1788582094.134308:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002003456 00000100:00100000:3.0:1788582094.134385:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 44 00000100:00100000:3.0:1788582094.134406:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dba93c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+6:2352:x1875464002003456:12345-192.168.201.12@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788582094.134605:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788582094.134609:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1788582093 -> 1788582093 00002000:00010000:3.0:1788582094.134611:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788582092 00002000:00010000:3.0:1788582094.134614:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1788582093 -> 1788582093 00002000:00010000:3.0:1788582094.134617:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788582094.134674:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dba93c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+7:2352:x1875464002003456:12345-192.168.201.12@tcp:2:lhsmtool_posix.0 Request processed in 280us (642us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788582094.134682:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 44 00000100:00100000:1.0:1788582094.136257:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582094.136330:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002003712 00000100:00100000:2.0:1788582094.136340:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002003712 00000100:00100000:2.0:1788582094.136408:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 127 00000100:00100000:2.0:1788582094.136417:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+15:10535:x1875464002003712:12345-192.168.201.12@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788582094.136481:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7460 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.136498:0:10136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a741a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c927c expref: 15 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.136507:0:10136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7460 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.136539:0:10136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a741a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c927c expref: 15 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.136553:0:10136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a741a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c927c expref: 15 pid: 10136 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582094.136567:0:10136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac142a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10136:1875464020885120:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582094.136641:0:10136:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8885a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788582094.138559:0:10136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac142a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10136:1875464020885120:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582094.138588:0:10136:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7460 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582094.139139:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582094.139323:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002003840 00000100:00100000:2.0:1788582094.139345:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002003840 00010000:00010000:2.0:1788582094.139380:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a741a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c927c expref: 16 pid: 10136 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582094.139427:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 59 00000100:00100000:2.0:1788582094.139436:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+16:2350:x1875464002003840:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788582094.139449:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582094.139456:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a741a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c927c expref: 16 pid: 10136 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.139469:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a741a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c927c expref: 16 pid: 10136 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.139492:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a741a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c927c expref: 16 pid: 10136 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.139507:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d0d85afc500) 00010000:00010000:2.0:1788582094.139512:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7460 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.139521:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7460 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.139528:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7460 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.139557:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582094.139607:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+15:2350:x1875464002003840:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 171us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582094.139623:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 59 00010000:00010000:1.0:1788582094.140015:0:10136:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7460 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.140023:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7460 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.140052:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7460 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.140059:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7460 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.140066:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7460 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.140072:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582094.140076:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7460 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.140084:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7460 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.140093:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d0d85afc500) 00010000:00010000:1.0:1788582094.140103:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788582094.140108:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7460 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.140114:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7460 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582094.140169:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+14:10535:x1875464002003712:12345-192.168.201.12@tcp:55:lhsmtool_posix.0 Request processed in 3752us (3919us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788582094.140178:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 127 00000100:00100000:1.0:1788582094.142314:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582094.142515:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002003968 00000100:00100000:0.0:1788582094.142525:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002003968 00000100:00100000:0.0:1788582094.142576:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 45 00000100:00100000:0.0:1788582094.142586:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+7:2349:x1875464002003968:12345-192.168.201.12@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788582094.142635:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7467 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582094.142656:0:6691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a7444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9298 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582094.142665:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582094.142669:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788582094.142674:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7467 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582094.142708:0:6691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a7444 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9298 expref: 7 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582094.142724:0:6691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a7444 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9298 expref: 7 pid: 6691 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582094.142740:0:6691:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbfb06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1875464020885248:192.168.201.12@tcp:104: 00000100:00100000:0.0:1788582094.142811:0:6691:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d866ec300 going to sleep for 11 seconds 00000100:00100000:0.0:1788582094.146947:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582094.147097:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002004096 00000100:00100000:3.0:1788582094.147106:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002004096 00010000:00010000:3.0:1788582094.147149:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a7444 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9298 expref: 8 pid: 6691 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582094.147192:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 60 00000100:00100000:3.0:1788582094.147225:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+8:2349:x1875464002004096:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582094.147241:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582094.147271:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a7444 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9298 expref: 8 pid: 6691 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.147300:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a7444 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9298 expref: 8 pid: 6691 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.147327:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788582094.147332:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788582094.147337:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7467 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.147347:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7467 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.147369:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582094.147442:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb07800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+8:2349:x1875464002004096:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 240us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582094.147450:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 60 00010000:00010000:2.0:1788582094.147761:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a7444 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9298 expref: 7 pid: 6691 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582094.147777:0:6691:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbfb06d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6691:1875464020885248:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582094.147798:0:6691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7467 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.147808:0:6691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7467 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.147814:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7467 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.147838:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7467 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.147845:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7467 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.147852:0:6691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7467 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.147859:0:6691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088000 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582094.147863:0:6691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7467 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.147880:0:6691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7467 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.147891:0:6691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7467 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.147898:0:6691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7467 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582094.147946:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:2349:x1875464002003968:12345-192.168.201.12@tcp:1:lhsmtool_posix.0 Request processed in 5361us (5640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582094.147954:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 45 00000100:00100000:3.0:1788582094.150366:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582094.150727:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002004352 00000100:00100000:1.0:1788582094.150738:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002004352 00000100:00100000:1.0:1788582094.150808:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 128 00000100:00100000:1.0:1788582094.150819:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+14:10535:x1875464002004352:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788582094.150909:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fce00/0x2bc3aa892c3a746e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.151254:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fce00/0x2bc3aa892c3a746e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.151271:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fce00/0x2bc3aa892c3a746e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.151695:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7475 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.151708:0:10137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7428 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9283 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.151716:0:10137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7475 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.151964:0:10137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7428 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9283 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582094.151980:0:10137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7428 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9283 expref: 15 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582094.151995:0:10137:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10137:1875464020885376:192.168.201.12@tcp:104: 00000100:00100000:1.0:1788582094.152227:0:10137:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d909e7a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788582094.161163:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582094.161302:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002004480 00000100:00100000:3.0:1788582094.161311:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002004480 00010000:00010000:3.0:1788582094.161360:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7428 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9283 expref: 16 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582094.161407:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 61 00000100:00100000:3.0:1788582094.161418:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+16:2349:x1875464002004480:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582094.161434:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582094.161441:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7428 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9283 expref: 16 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.161479:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7428 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9283 expref: 16 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.161500:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d0d85afc500) 00010000:00010000:3.0:1788582094.161505:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7475 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.161514:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7475 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.161521:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7475 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.161539:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582094.161600:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+16:2349:x1875464002004480:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 184us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582094.161608:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 61 00010000:00010000:2.0:1788582094.164962:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7428 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9283 expref: 15 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582094.164991:0:10137:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c0000 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10137:1875464020885376:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582094.165024:0:10137:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7475 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.165034:0:10137:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7475 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.165039:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7475 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788582094.165360:0:10137:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:2.0:1788582094.165537:0:10137:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1788582094.165582:0:10137:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:2.0:1788582094.165669:0:10137:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac142a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10137:1875464020885504:0@lo:1000:mdt00_004.0 00000100:00100000:2.0:1788582094.165729:0:10137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582094.165772:0:10137:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dac24a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788582094.165890:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020885504 00000100:00100000:1.0:1788582094.165898:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020885504 00000100:00100000:1.0:1788582094.165947:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788582094.165957:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10137:x1875464020885504:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788582094.166055:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac140000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10137:x1875464020885504:12345-0@lo:1000:mdt00_004.0 Request processed in 100us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582094.166062:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788582094.167132:0:10137:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1788582094.167141:0:10137:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:3.0:1788582094.167159:0:10137:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d0dbfb05880, transno 4294967309 00000100:00100000:3.0:1788582094.167186:0:10137:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8d0dbfb04a80 x1875464020884736/t4294967310(4294967310) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788582110 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788582094.167199:0:10137:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac142a00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10137:1875464020885504:0@lo:1000:mdt00_004.0 00000001:00080000:3.0:1788582094.167788:0:10137:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1788582094.167862:0:10137:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbad09f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10137:1875464020885632:0@lo:1000:mdt00_004.0 00000100:00100000:3.0:1788582094.167925:0:10137:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582094.168660:0:10137:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85b42f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788582094.169245:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020885632 00000100:00100000:1.0:1788582094.169255:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020885632 00000100:00100000:1.0:1788582094.169453:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788582094.169464:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10137:x1875464020885632:12345-0@lo:1000:mdt00_004.0 00000100:00100000:1.0:1788582094.169729:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad0ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:10137:x1875464020885632:12345-0@lo:1000:mdt00_004.0 Request processed in 267us (1803us total) trans 4294967312 rc 0/0 00000100:00100000:1.0:1788582094.169737:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788582094.169969:0:10137:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbad09f80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-mdtlov_UUID:10137:1875464020885632:0@lo:1000:mdt00_004.0 00010000:00010000:3.0:1788582094.170024:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7475 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.170036:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7475 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.170044:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7475 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.170050:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fca00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582094.170055:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7475 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.170062:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7475 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.170086:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d0d85afc500) 00010000:00010000:3.0:1788582094.170089:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788582094.170093:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7475 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.170099:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fca00/0x2bc3aa892c3a7475 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.170126:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a73b8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.170132:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a73b8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.170138:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a73b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.170153:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fc200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582094.170156:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a73b8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.170162:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a73b8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.170169:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:3.0:1788582094.170171:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788582094.170178:0:10137:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a73bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9267 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.170190:0:10137:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a73bf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9267 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.170199:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a73bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9267 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.170251:0:10137:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a73bf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9267 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582094.170264:0:10137:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbad0b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10137:1875464020885760:192.168.201.12@tcp:105: 00000100:00100000:3.0:1788582094.170349:0:10137:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8885a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788582094.174727:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582094.175070:0:10137:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbad0b100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10137:1875464020885760:192.168.201.12@tcp:105: 00010000:00010000:3.0:1788582094.175114:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a73b8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.175143:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a73b8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582094.175175:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002004608 00010000:00010000:3.0:1788582094.175183:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a747c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582094.175183:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002004608 00010000:00010000:3.0:1788582094.175196:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a747c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.175235:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a747c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.175245:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a747c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.175251:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a747c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582094.175252:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 284 00010000:00010000:3.0:1788582094.175258:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a747c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582094.175262:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2349:x1875464002004608:12345-192.168.201.12@tcp:400:kworker.0 00010000:00010000:3.0:1788582094.175264:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582094.175268:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a747c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.175274:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a747c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.175284:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:3.0:1788582094.175287:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582094.175290:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a747c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.175302:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a747c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.175312:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fce00/0x2bc3aa892c3a746e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.175318:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fce00/0x2bc3aa892c3a746e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.175323:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fce00/0x2bc3aa892c3a746e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.175328:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fce00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582094.175331:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fce00/0x2bc3aa892c3a746e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.175337:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fce00/0x2bc3aa892c3a746e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582094.175343:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3333050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2349:x1875464002004608:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 83us (625us total) trans 0 rc 0/0 00010000:00010000:3.0:1788582094.175344:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:3.0:1788582094.175346:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788582094.175349:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fce00/0x2bc3aa892c3a746e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582094.175351:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 284 00010000:00010000:3.0:1788582094.175355:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fce00/0x2bc3aa892c3a746e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582094.175571:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad0b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+18:10535:x1875464002004352:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 Request processed in 24753us (25214us total) trans 4294967406 rc 0/0 00000100:00100000:3.0:1788582094.175581:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 128 00000020:00080000:3.0:1788582094.175591:0:10137:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788582094.175697:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788582094.175702:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788582094.176227:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788582094.176235:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788582094.179848:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582094.179890:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582094.179940:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582094.179970:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582094.180169:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002004864 00000100:00100000:3.0:1788582094.180179:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002004864 00000100:00100000:3.0:1788582094.180290:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 124 00000100:00100000:3.0:1788582094.180302:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2349:x1875464002004864:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582094.180377:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2349:x1875464002004864:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 78us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582094.180386:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 124 00000100:00100000:2.0:1788582094.180422:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002004992 00000100:00100000:2.0:1788582094.180427:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002004992 00000100:00100000:2.0:1788582094.180461:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002005248 00000100:00100000:2.0:1788582094.180464:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002005248 00000100:00100000:2.0:1788582094.180477:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 31 00000100:00100000:2.0:1788582094.180483:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+19:10533:x1875464002004992:12345-192.168.201.12@tcp:49:lfs.0 00000100:00100000:2.0:1788582094.180555:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+19:10533:x1875464002004992:12345-192.168.201.12@tcp:49:lfs.0 Request processed in 73us (665us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582094.180562:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 31 00000100:00100000:2.0:1788582094.180573:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 32 00000100:00100000:2.0:1788582094.180578:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d84f83c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+18:10535:x1875464002005248:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788582094.181361:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788582094.181464:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1788582094.181510:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7483 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.181527:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.181538:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7483 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.181546:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7483 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.181552:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7483 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.181559:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7483 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.181579:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788582094.181636:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d84f83c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+20:10535:x1875464002005248:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 Request processed in 1055us (1663us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1788582094.181644:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 32 00000020:00080000:2.0:1788582094.181649:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:1.0:1788582094.181781:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788582094.181970:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582094.181976:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7483 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.181983:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04800 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582094.181988:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7483 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.182002:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7483 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.182026:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff8d0d85afc800) 00010000:00010000:2.0:1788582094.182029:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788582094.182033:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7483 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.182039:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7483 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.182056:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582094.182058:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582094.182060:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582094.182245:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002004736 00000100:00100000:0.0:1788582094.182253:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002004736 00000100:00100000:0.0:1788582094.182313:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 57 00000100:00100000:0.0:1788582094.182334:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+5:2350:x1875464002004736:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582094.182375:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+5:2350:x1875464002004736:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 45us (2537us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582094.182381:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 57 00000100:00080000:1.0:1788582094.182547:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788582094.184940:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582094.185064:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002005504 00000100:00100000:1.0:1788582094.185076:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002005504 00000100:00100000:1.0:1788582094.185138:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 129 00000100:00100000:1.0:1788582094.185149:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+20:10533:x1875464002005504:12345-192.168.201.12@tcp:58:lfs.0 00000040:00080000:1.0:1788582094.185449:0:10136:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788582094.185533:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad0b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+20:10533:x1875464002005504:12345-192.168.201.12@tcp:58:lfs.0 Request processed in 385us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582094.185540:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 129 00000100:00100000:0.0:1788582094.222281:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582094.222389:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002005632 00000100:00100000:3.0:1788582094.222400:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002005632 00000100:00100000:3.0:1788582094.222457:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 130 00000100:00100000:3.0:1788582094.222467:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+20:10538:x1875464002005632:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:3.0:1788582094.222492:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582094.222512:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a748a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c929f expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.222578:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7491 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.222594:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7491 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.222606:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7491 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.222621:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7498 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.222628:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.222649:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.223014:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a749f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.223028:0:10137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a73aa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9260 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.223036:0:10137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a749f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.223071:0:10137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a73aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9260 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.223085:0:10137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a73aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9260 expref: 21 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582094.223100:0:10137:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbad09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10137:1875464020885888:192.168.201.12@tcp:104: 00000100:00100000:3.0:1788582094.226403:0:10137:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8885a6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788582094.228989:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582094.229153:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002005888 00000100:00100000:1.0:1788582094.229164:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002005888 00000100:00100000:1.0:1788582094.229243:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 33 00000100:00100000:3.0:1788582094.229246:0:10137:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbad09c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10137:1875464020885888:192.168.201.12@tcp:104: 00000100:00100000:1.0:1788582094.229258:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+22:5586:x1875464002005888:12345-192.168.201.12@tcp:35:ldlm_bl.0 00010000:00010000:3.0:1788582094.229279:0:10137:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a749f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582094.229495:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac141180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+23:5586:x1875464002005888:12345-192.168.201.12@tcp:35:ldlm_bl.0 Request processed in 241us (515us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788582094.229503:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 33 00000100:00100000:1.0:1788582094.233861:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582094.234115:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002006016 00000100:00100000:3.0:1788582094.234126:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002006016 00010000:00010000:3.0:1788582094.234173:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a73aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9260 expref: 23 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582094.234273:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 62 00000100:00100000:3.0:1788582094.234284:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da7246050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+23:2350:x1875464002006016:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582094.234300:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582094.234308:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a73aa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9260 expref: 23 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.234320:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a73aa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9260 expref: 23 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.234343:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a73aa lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9260 expref: 23 pid: 5844 timeout: 413 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.234371:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:3.0:1788582094.234377:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a749f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.234387:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a749f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.234403:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a749f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582094.234438:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788582094.234475:0:10137:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a749f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.234486:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a749f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582094.234505:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da7246050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+22:2350:x1875464002006016:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 222us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582094.234515:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 62 00000004:00200000:2.0:1788582094.234527:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1788582094.234532:0:10137:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788582094.234551:0:10137:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a749f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.234563:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a749f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.234573:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7491 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.234590:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7491 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.234597:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7491 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.234602:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582094.234606:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7491 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.234612:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7491 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.234622:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:2.0:1788582094.234624:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582094.234628:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7491 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.234633:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7491 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.234644:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7498 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.234651:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7498 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.234657:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.234662:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582094.234673:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7498 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.234680:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7498 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.234688:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff8d0d917bdb00) 00010000:00010000:2.0:1788582094.234691:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582094.234694:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7498 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.234700:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7498 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.234734:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a748a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c929f expref: 22 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.234759:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a749f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c929f expref: 21 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582094.234767:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:2.0:1788582094.234769:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788582094.234772:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27a00, rc 0) 00000100:00100000:2.0:1788582094.234812:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb05880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+21:10538:x1875464002005632:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 12346us (12542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582094.234820:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 130 00010000:00010000:2.0:1788582094.574142:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788582094.983193:0:12106:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788582094.983235:0:12106:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788582094.983287:0:12106:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788582094.983298:0:12106:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1788582095.213760:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788582095.213768:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788582095.213798:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788582095.213804:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788582095.213916:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbfb04700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875464020886016:192.168.201.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788582095.214083:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8885ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788582095.215904:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbfb04700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875464020886016:192.168.201.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788582095.217343:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582095.217453:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002006144 00000100:00100000:0.0:1788582095.217463:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002006144 00000100:00100000:0.0:1788582095.217586:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 131 00000100:00100000:0.0:1788582095.217596:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+21:10550:x1875464002006144:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788582095.217631:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788582095.217818:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad09880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+21:10550:x1875464002006144:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 Request processed in 223us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582095.217826:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 131 00000100:00100000:1.0:1788582095.227874:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582095.228045:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002006400 00000100:00100000:3.0:1788582095.228057:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002006400 00000100:00100000:3.0:1788582095.228401:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 132 00000100:00100000:3.0:1788582095.228413:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+21:10550:x1875464002006400:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788582095.228434:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582095.228454:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a74a6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c92a6 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582095.228558:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582095.228572:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582095.228593:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582095.228606:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788582095.228732:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a74a6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92a6 expref: 24 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582095.228751:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92a6 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582095.228759:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:3.0:1788582095.228762:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788582095.228766:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26800, rc 0) 00000100:00100000:3.0:1788582095.228821:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+23:10550:x1875464002006400:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 411us (956us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788582095.228843:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 132 00000100:00100000:2.0:1788582095.237601:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582095.239524:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002006528 00000100:00100000:3.0:1788582095.239544:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002006528 00000100:00100000:3.0:1788582095.239642:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 7 00000100:00100000:3.0:1788582095.239657:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac142d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+23:2352:x1875464002006528:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582095.239674:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582095.239700:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92a6 expref: 23 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582095.239720:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:3.0:1788582095.239724:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582095.239817:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac142d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+22:2352:x1875464002006528:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 161us (2221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582095.239831:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 7 00000100:00100000:0.0:1788582095.248411:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582095.248592:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002006784 00000100:00100000:2.0:1788582095.248602:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002006784 00000100:00100000:2.0:1788582095.248674:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 133 00000100:00100000:2.0:1788582095.248685:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+22:10550:x1875464002006784:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788582095.248794:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a74bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582095.248812:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a74bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582095.248825:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a74bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582095.249029:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a74bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582095.249038:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a74bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582095.249045:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a74bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582095.249051:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582095.249055:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a74bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582095.249063:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a74bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582095.249074:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:2.0:1788582095.249087:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788582095.249092:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a74bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582095.249519:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a74bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582095.249907:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb04700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+23:10550:x1875464002006784:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 Request processed in 1222us (1503us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1788582095.249917:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 133 00000040:00080000:2.0:1788582095.255144:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788582095.255153:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788582095.255998:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788582095.256010:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788582095.256604:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582095.256682:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002007040 00000100:00100000:0.0:1788582095.256692:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002007040 00000100:00100000:0.0:1788582095.256748:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 34 00000100:00100000:0.0:1788582095.256760:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+23:10550:x1875464002007040:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788582095.257040:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+24:10550:x1875464002007040:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 Request processed in 282us (439us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1788582095.257048:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 34 00010000:00010000:2.0:1788582095.598175:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582096.366409:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbfb04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875464020886272:0@lo:400:kworker.0 00000100:00100000:0.0:1788582096.366479:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582096.366532:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbfb05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020886784:0@lo:400:kworker.0 00000100:00100000:0.0:1788582096.366557:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582096.366589:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788582096.366595:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbfb07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020886144:0@lo:400:kworker.0 00000100:00100000:0.0:1788582096.366621:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582096.366643:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbfb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875464020886656:0@lo:400:kworker.0 00000100:00100000:0.0:1788582096.366665:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582096.366688:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbfb06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020886400:0@lo:400:kworker.0 00000100:00100000:0.0:1788582096.366709:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582096.366725:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788582096.366730:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbfb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020886528:0@lo:400:kworker.0 00000100:00100000:0.0:1788582096.366748:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582096.366776:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020886272 00000100:00100000:0.0:1788582096.366784:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020886272 00000100:00100000:0.0:1788582096.366834:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020886656 00000100:00100000:0.0:1788582096.366838:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020886656 00000100:00100000:0.0:1788582096.366862:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020886400 00000100:00100000:0.0:1788582096.366864:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020886400 00000100:00100000:0.0:1788582096.366879:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788582096.366887:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875464020886272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582096.366936:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb04000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875464020886272:12345-0@lo:400:kworker.0 Request processed in 49us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582096.366953:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788582096.366982:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788582096.366988:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875464020886656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582096.367017:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875464020886656:12345-0@lo:400:kworker.0 Request processed in 30us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582096.367023:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788582096.367034:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788582096.367040:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020886400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582096.367068:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020886400:12345-0@lo:400:kworker.0 Request processed in 28us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582096.367073:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788582096.367089:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020886144 00000100:00100000:0.0:1788582096.367092:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020886144 00000100:00100000:0.0:1788582096.367113:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788582096.367119:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3332c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3307:x1875464020886144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582096.367146:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3332c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3307:x1875464020886144:12345-0@lo:400:kworker.0 Request processed in 27us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582096.367152:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788582096.367179:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020886784 00000100:00100000:0.0:1788582096.367183:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020886784 00000100:00100000:0.0:1788582096.367228:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020886528 00000100:00100000:0.0:1788582096.367232:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020886528 00000100:00100000:0.0:1788582096.367251:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788582096.367257:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1875464020886784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582096.367291:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf431500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1875464020886784:12345-0@lo:400:kworker.0 Request processed in 34us (733us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582096.367306:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788582096.367317:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788582096.367323:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875464020886528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582096.367348:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875464020886528:12345-0@lo:400:kworker.0 Request processed in 26us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582096.367353:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788582096.367399:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbfb05180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020886528:0@lo:400:kworker.0 00000100:00100000:0.0:1788582096.367409:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbfb06d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020886400:0@lo:400:kworker.0 00000100:00100000:0.0:1788582096.367433:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbfb07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020886144:0@lo:400:kworker.0 00000100:00100000:0.0:1788582096.367442:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbfb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875464020886656:0@lo:400:kworker.0 00000100:00100000:0.0:1788582096.367450:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbfb04380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875464020886272:0@lo:400:kworker.0 00000100:00100000:0.0:1788582096.367458:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbfb05500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020886784:0@lo:400:kworker.0 00000100:00080000:0.0:1788582096.367508:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788582096.367512:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788582096.367514:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788582096.371070:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020886912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788582096.371140:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582096.372057:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020886912 00000100:00100000:3.0:1788582096.372065:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020886912 00000100:00100000:3.0:1788582096.372114:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788582096.372123:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875464020886912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788582096.372158:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788582096.379174:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac142a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3308:x1875464020886912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 7041us (8023us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582096.379189:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788582096.379743:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf430000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020886912:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788582096.621308:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788582096.727330:0:12157:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788582096.727342:0:12157:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788582096.727689:0:12157:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788582096.727695:0:12157:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788582096.833747:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582096.834023:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002007296 00000100:00100000:0.0:1788582096.834033:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002007296 00000100:00100000:0.0:1788582096.834131:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 134 00000100:00100000:0.0:1788582096.834141:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+24:10570:x1875464002007296:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:0.0:1788582096.834164:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582096.834182:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a74c2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c92ad expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582096.834304:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a74c9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582096.834318:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a74c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582096.834329:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a74c9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582096.834339:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000100:00080000:1.0:1788582096.834428:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788582096.834563:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088400/0x2bc3aa892c3a74c2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92ad expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582096.834578:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a74c9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92ad expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582096.834586:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:0.0:1788582096.834589:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788582096.834592:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7088200, rc 0) 00000100:00100000:0.0:1788582096.834651:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+26:10570:x1875464002007296:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 511us (911us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1788582096.834659:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 134 00000100:00100000:3.0:1788582096.837052:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582096.837086:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002007424 00000100:00100000:3.0:1788582096.837094:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002007424 00000100:00100000:3.0:1788582096.837137:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 135 00000100:00100000:3.0:1788582096.837146:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+26:10570:x1875464002007424:12345-192.168.201.12@tcp:54:lfs.0 00010000:00010000:3.0:1788582096.837220:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582096.837272:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582096.837284:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582096.837307:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582096.837314:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582096.837320:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582096.837325:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582096.837330:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582096.837337:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582096.837353:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:3.0:1788582096.837356:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788582096.837372:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582096.837378:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582096.837439:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad09c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+26:10570:x1875464002007424:12345-192.168.201.12@tcp:54:lfs.0 Request processed in 293us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582096.837446:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 135 00000100:00100000:1.0:1788582096.893863:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582096.894102:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002007552 00000100:00100000:0.0:1788582096.894112:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002007552 00000100:00080000:1.0:1788582096.894155:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788582096.894185:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 46 00000100:00100000:0.0:1788582096.894197:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+6:2352:x1875464002007552:12345-192.168.201.12@tcp:101:cat.0 00010000:00010000:0.0:1788582096.894240:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582096.894277:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a74de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c92b4 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788582096.894367:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9b98cd, atime: 0x6a9b98cc, ctime: 0x6a9b98cd, blocks: 0xb 00010000:00010000:0.0:1788582096.894385:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=315s v=(0 0) 00010000:00010000:0.0:1788582096.894389:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582096.894397:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a74de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92b4 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582096.894412:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a74de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92b4 expref: 7 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582096.894422:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7088400, rc 0) 00000100:00100000:0.0:1788582096.894469:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+7:2352:x1875464002007552:12345-192.168.201.12@tcp:101:cat.0 Request processed in 275us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582096.894477:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 46 00000100:00100000:3.0:1788582096.896674:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582096.896728:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002007680 00000100:00100000:0.0:1788582096.896737:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002007680 00002000:00100000:0.0:1788582096.896781:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8d0d91a0b480 x1875464002007680/t0(0) o3->b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp:697/0 lens 488/0 e 0 to 0 dl 1788582107 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788582096.896792:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0d91a0b480 with x1875464002007680 ext(0->4095) 00002000:00010000:0.0:1788582096.896797:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0d91a0b480 00000100:00100000:0.0:1788582096.896837:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 3 00000100:00100000:0.0:1788582096.896846:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b99087a3-3c83-4416-b2b9-d522b9885111+7:2351:x1875464002007680:12345-192.168.201.12@tcp:3:cat.0 00000100:00100000:1.0:1788582096.896848:0:6698:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1788582096.896864:0:6698:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1788582096.897094:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a0b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b99087a3-3c83-4416-b2b9-d522b9885111+7:2351:x1875464002007680:12345-192.168.201.12@tcp:3:cat.0 Request processed in 248us (435us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788582096.897107:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 3 00002000:00100000:0.0:1788582096.897113:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff8d0d91a0b480 x1875464002007680/t0(0) o3->b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp:697/0 lens 488/4536 e 0 to 0 dl 1788582107 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788582096.897119:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0d91a0b480 with x1875464002007680 ext(0->4095) 00002000:00010000:0.0:1788582096.897122:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0d91a0b480 00010000:00010000:3.0:1788582097.650093:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582097.901592:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf432d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020887040:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788582097.901654:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582097.901780:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020887040 00000100:00100000:0.0:1788582097.901788:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020887040 00000100:00100000:0.0:1788582097.907400:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788582097.907431:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875464020887040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788582097.907475:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582097.907568:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875464020887040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 154us (5911us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582097.907574:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788582097.907664:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf432d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020887040:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788582098.445050:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00010000:00010000:2.0:1788582098.669329:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582099.297395:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582099.300356:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582099.300431:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582099.300458:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582099.300481:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582099.300511:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002008320 00000100:00100000:0.0:1788582099.300519:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002008320 00000100:00100000:0.0:1788582099.300561:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002007936 00000100:00100000:0.0:1788582099.300563:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002007936 00000100:00100000:0.0:1788582099.300576:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 128 00000100:00100000:0.0:1788582099.300583:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2349:x1875464002008320:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582099.300641:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2349:x1875464002008320:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 59us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582099.300760:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 128 00000100:00100000:0.0:1788582099.300774:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 129 00000100:00100000:0.0:1788582099.300779:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+26:2349:x1875464002007936:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582099.300799:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+26:2349:x1875464002007936:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 21us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582099.300803:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 129 00000100:00100000:0.0:1788582099.300815:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002008064 00000100:00100000:0.0:1788582099.300818:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002008064 00000100:00100000:0.0:1788582099.300834:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002008192 00000100:00100000:0.0:1788582099.300835:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002008192 00000100:00100000:0.0:1788582099.300846:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 60 00000100:00100000:0.0:1788582099.300851:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+5:2349:x1875464002008064:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582099.300865:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+5:2349:x1875464002008064:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 15us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582099.300869:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 60 00000100:00100000:0.0:1788582099.300875:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 61 00000100:00100000:0.0:1788582099.300878:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+7:2349:x1875464002008192:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582099.300890:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb05500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+7:2349:x1875464002008192:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 11us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582099.300893:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 61 00000100:00080000:0.0:1788582099.300928:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788582099.300932:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788582099.300934:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788582099.301188:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002007808 00000100:00100000:2.0:1788582099.301192:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002007808 00000100:00100000:2.0:1788582099.301233:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 286 00000100:00100000:2.0:1788582099.301237:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da3332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2349:x1875464002007808:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788582099.301262:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da3332450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2349:x1875464002007808:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 26us (3875us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582099.301267:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 286 00000001:00080000:3.0:1788582099.535644:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:3.0:1788582099.535673:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:3.0:1788582099.535800:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:3.0:1788582099.535832:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:0.0:1788582099.536350:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d0d85b42480 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1788582099.536357:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d0da72b6300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d0d85b42d80 00000020:00080000:0.0:1788582099.536371:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d0da72b6c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d0dac0d0800 00000020:00080000:0.0:1788582099.536389:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:0.0:1788582099.536537:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:1.0:1788582099.558050:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1788582099.558070:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000001:00080000:1.0:1788582099.558078:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00010000:00010000:2.0:1788582099.693369:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582100.719863:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582101.229867:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582101.229958:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002008448 00000100:00100000:3.0:1788582101.229968:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002008448 00000100:00100000:3.0:1788582101.230042:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 136 00000100:00100000:3.0:1788582101.230055:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+13:10214:x1875464002008448:12345-192.168.201.12@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788582101.230153:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb04380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+13:10214:x1875464002008448:12345-192.168.201.12@tcp:60:lhsmtool_posix.0 Request processed in 103us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582101.230161:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 136 00000100:00080000:0.0:1788582101.230338:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788582101.233081:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582101.241728:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002008704 00000100:00100000:2.0:1788582101.241743:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002008704 00000100:00100000:2.0:1788582101.241824:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 35 00000100:00100000:2.0:1788582101.241834:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+13:10214:x1875464002008704:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788582101.242453:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+14:10214:x1875464002008704:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 Request processed in 618us (9379us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788582101.242462:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 35 00000100:00100000:2.0:1788582101.485780:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020887424:0@lo:400:kworker.0 00000100:00100000:2.0:1788582101.485858:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582101.485929:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788582101.485935:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020887552:0@lo:400:kworker.0 00000100:00100000:2.0:1788582101.485959:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582101.485993:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020887424 00000100:00100000:2.0:1788582101.485999:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020887424 00000100:00100000:2.0:1788582101.486071:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788582101.486080:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020887424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582101.486128:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020887424:12345-0@lo:400:kworker.0 Request processed in 49us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582101.486135:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788582101.486159:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020887552 00000100:00100000:2.0:1788582101.486163:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020887552 00000100:00100000:2.0:1788582101.486224:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788582101.486403:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020887552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582101.486436:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020887552:12345-0@lo:400:kworker.0 Request processed in 36us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582101.486442:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1788582101.486478:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788582101.486482:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788582101.486504:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788582101.486510:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d0dbad09500, transno 4294967304 00000100:00100000:2.0:1788582101.486521:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020887552:0@lo:400:kworker.0 00000100:00100000:2.0:1788582101.486532:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaef8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020887424:0@lo:400:kworker.0 00000100:00100000:1.0:1788582101.487027:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020887168:0@lo:400:kworker.0 00000100:00100000:1.0:1788582101.487064:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582101.487089:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020887680:0@lo:400:kworker.0 00000100:00100000:1.0:1788582101.487110:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582101.487128:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788582101.487134:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020887296:0@lo:400:kworker.0 00000100:00100000:1.0:1788582101.487154:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582101.487171:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020887808:0@lo:400:kworker.0 00000100:00100000:1.0:1788582101.487190:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582101.487247:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020887168 00000100:00100000:1.0:1788582101.487252:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020887168 00000100:00100000:1.0:1788582101.487282:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788582101.487289:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3306:x1875464020887168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582101.487460:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020887680 00000100:00100000:3.0:1788582101.487465:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020887680 00000100:00100000:3.0:1788582101.487492:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020887296 00000100:00100000:3.0:1788582101.487495:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020887296 00000100:00100000:3.0:1788582101.487508:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788582101.487514:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020887680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582101.487559:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020887680:12345-0@lo:400:kworker.0 Request processed in 45us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582101.487566:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788582101.487579:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788582101.487585:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020887296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582101.487729:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020887296:12345-0@lo:400:kworker.0 Request processed in 144us (573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582101.487735:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788582101.487764:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020887808 00000100:00100000:3.0:1788582101.487767:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020887808 00000100:00100000:3.0:1788582101.487790:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788582101.487797:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020887808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582101.487838:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020887808:12345-0@lo:400:kworker.0 Request processed in 41us (646us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582101.487843:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788582101.487895:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaef8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020887296:0@lo:400:kworker.0 00000100:00100000:3.0:1788582101.487905:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1788582101.487909:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d0dbfb04a80, transno 4294967310 00000004:00080000:3.0:1788582101.487918:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:3.0:1788582101.487934:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b37800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020887808:0@lo:400:kworker.0 00000100:00100000:3.0:1788582101.487944:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020887680:0@lo:400:kworker.0 00000100:00100000:1.0:1788582101.488063:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3306:x1875464020887168:12345-0@lo:400:kworker.0 Request processed in 774us (998us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582101.488070:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1788582101.488318:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788582101.488329:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbfb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020887936:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788582101.488366:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582101.488396:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020887936 00000100:00100000:1.0:1788582101.488400:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020887936 00000100:00100000:1.0:1788582101.488427:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788582101.488434:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020887936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788582101.488459:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788582101.488494:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020887936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (127us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582101.488500:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788582101.488528:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbfb06300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020887936:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788582101.489126:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaef9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020887168:0@lo:400:kworker.0 00000100:00080000:2.0:1788582101.489249:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788582101.489254:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788582101.568919:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582101.569052:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002008832 00000100:00100000:3.0:1788582101.569063:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002008832 00000100:00100000:3.0:1788582101.569152:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 137 00000100:00100000:3.0:1788582101.569162:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:11022:x1875464002008832:12345-192.168.201.12@tcp:101:lsof.0 00010000:00010000:3.0:1788582101.569181:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582101.569223:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a74e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c92bb expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582101.569297:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74ec lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582101.569312:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582101.569325:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582101.569358:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788582101.569362:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788582101.569400:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74ec lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582101.569421:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a74e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92bb expref: 7 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582101.569439:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92bb expref: 6 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582101.569448:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d85afcc00) 00010000:00010000:3.0:1788582101.569450:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788582101.569454:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26800, rc 0) 00000100:00100000:3.0:1788582101.569522:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a85b5d8-11d7-4e00-8094-5ec4da71e638+6:11022:x1875464002008832:12345-192.168.201.12@tcp:101:lsof.0 Request processed in 360us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582101.569535:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 137 00000100:00080000:2.0:1788582101.570120:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788582101.742235:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788582102.445471:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788582102.445481:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788582102.445945:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1788582102.445951:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788582102.765415:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788582103.022490:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788582103.022514:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbfb04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020888064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788582103.022605:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582103.022887:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020888064 00000100:00100000:0.0:1788582103.022896:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020888064 00000100:00100000:0.0:1788582103.022967:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788582103.022979:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020888064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788582103.023019:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582103.023066:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020888064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582103.023073:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1788582103.023191:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788582103.023254:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbfb04a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020888064:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788582103.790150:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582104.415107:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582104.415149:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582104.415178:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582104.415216:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582104.415242:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582104.415268:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002009472 00000100:00100000:1.0:1788582104.415287:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002009472 00000100:00100000:1.0:1788582104.415337:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002009088 00000100:00100000:1.0:1788582104.415339:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002009088 00000100:00100000:1.0:1788582104.415359:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 133 00000100:00100000:1.0:1788582104.415367:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a85b5d8-11d7-4e00-8094-5ec4da71e638+6:2352:x1875464002009472:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582104.415431:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a85b5d8-11d7-4e00-8094-5ec4da71e638+6:2352:x1875464002009472:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 64us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582104.415438:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 133 00000100:00100000:1.0:1788582104.415455:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 134 00000100:00100000:1.0:1788582104.415461:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+14:2352:x1875464002009088:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582104.415498:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+14:2352:x1875464002009088:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 36us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582104.415505:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 134 00000100:00080000:1.0:1788582104.415526:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788582104.415636:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002009216 00000100:00100000:2.0:1788582104.415641:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002009216 00000100:00100000:2.0:1788582104.415681:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002009344 00000100:00100000:2.0:1788582104.415684:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002009344 00000100:00100000:2.0:1788582104.415706:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 64 00000100:00100000:2.0:1788582104.415714:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+5:2352:x1875464002009216:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788582104.415741:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+5:2352:x1875464002009216:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 28us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582104.415747:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 64 00000100:00100000:2.0:1788582104.415759:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 65 00000100:00100000:2.0:1788582104.415764:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+6:2352:x1875464002009344:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788582104.415785:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+6:2352:x1875464002009344:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 21us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582104.415792:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 65 00000100:00080000:1.0:1788582104.416098:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788582104.416102:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788582104.416476:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002008960 00000100:00100000:3.0:1788582104.416481:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002008960 00000100:00100000:3.0:1788582104.416521:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 288 00000100:00100000:3.0:1788582104.416528:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2352:x1875464002008960:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582104.416572:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2352:x1875464002008960:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 44us (1475us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582104.416578:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 288 00000020:00080000:3.0:1788582104.628688:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:3.0:1788582104.628710:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1788582104.628729:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1788582104.628741:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:2.0:1788582104.814060:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788582104.932968:0:12362:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 00:21:43 (1788582103) 00010000:00010000:2.0:1788582105.837369:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788582106.605647:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbfb07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020888192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788582106.605720:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582106.605971:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020888192 00000100:00100000:0.0:1788582106.605980:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020888192 00000100:00100000:0.0:1788582106.606051:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788582106.606062:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020888192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788582106.606097:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582106.606153:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad09500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020888192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582106.606160:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788582106.606253:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbfb07800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020888192:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1788582106.606382:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788582106.606712:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020888448:0@lo:400:kworker.0 00000100:00100000:3.0:1788582106.606743:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582106.606765:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788582106.606770:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020888576:0@lo:400:kworker.0 00000100:00100000:3.0:1788582106.606803:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582106.606844:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020888448 00000100:00100000:3.0:1788582106.606849:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020888448 00000100:00100000:3.0:1788582106.606876:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020888576 00000100:00100000:3.0:1788582106.606879:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020888576 00000100:00100000:3.0:1788582106.606905:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788582106.606911:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020888448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582106.606947:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020888448:12345-0@lo:400:kworker.0 Request processed in 36us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582106.606953:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788582106.606967:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788582106.606973:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020888576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582106.606997:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020888576:12345-0@lo:400:kworker.0 Request processed in 26us (204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582106.607003:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1788582106.607016:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788582106.607033:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020888576:0@lo:400:kworker.0 00000100:00100000:3.0:1788582106.607042:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020888448:0@lo:400:kworker.0 00000100:00100000:1.0:1788582106.607168:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0da702d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020888320:0@lo:400:kworker.0 00000100:00100000:1.0:1788582106.607230:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582106.607262:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabc09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875464020888832:0@lo:400:kworker.0 00000100:00100000:1.0:1788582106.607308:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582106.607328:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788582106.607334:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020888704:0@lo:400:kworker.0 00000100:00100000:1.0:1788582106.607356:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582106.607830:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020888832 00000100:00100000:2.0:1788582106.607836:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020888832 00000100:00100000:2.0:1788582106.607886:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788582106.607894:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875464020888832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582106.607937:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875464020888832:12345-0@lo:400:kworker.0 Request processed in 44us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582106.607943:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788582106.607963:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020888704 00000100:00100000:2.0:1788582106.607967:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020888704 00000100:00100000:2.0:1788582106.607994:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788582106.608001:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020888704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582106.608030:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020888704:12345-0@lo:400:kworker.0 Request processed in 31us (673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582106.608036:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1788582106.608099:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788582106.608102:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788582106.608121:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabc08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020888704:0@lo:400:kworker.0 00000100:00100000:1.0:1788582106.608129:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabc09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875464020888832:0@lo:400:kworker.0 00000100:00100000:3.0:1788582106.608289:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020888320 00000100:00100000:3.0:1788582106.608293:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020888320 00000100:00100000:3.0:1788582106.608326:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788582106.608332:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3307:x1875464020888320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582106.608381:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3307:x1875464020888320:12345-0@lo:400:kworker.0 Request processed in 50us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582106.608387:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1788582106.608505:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0da702d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020888320:0@lo:400:kworker.0 00010000:00010000:3.0:1788582106.864808:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582106.984890:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582106.985408:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002009728 00000100:00100000:3.0:1788582106.985420:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002009728 00000100:00100000:3.0:1788582106.985497:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 138 00000100:00100000:3.0:1788582106.985507:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+13:11287:x1875464002009728:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788582106.985528:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582106.985548:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a74f3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c92c2 expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.985613:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a74fa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.985626:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a74fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.985637:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a74fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.985650:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7501 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.985658:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7501 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.985664:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7501 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788582106.985859:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788582106.985897:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7508 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.985907:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7508 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.985914:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7508 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582106.985922:0:10136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788582106.986051:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a74fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.986059:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a74fa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.986066:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a74fa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.986072:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582106.986076:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a74fa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.986084:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a74fa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.986095:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d0da2faf900) 00010000:00010000:3.0:1788582106.986098:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582106.986102:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a74fa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.986117:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a74fa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.986128:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7501 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.986135:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7501 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.986141:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7501 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.986145:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582106.986148:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7501 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.986154:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7501 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.986444:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d0d917bd000) 00010000:00010000:3.0:1788582106.986448:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582106.986451:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7501 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.986458:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7501 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.986838:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a74f3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92c2 expref: 16 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.986864:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7508 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92c2 expref: 15 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582106.986873:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d0d888de500) 00010000:00010000:3.0:1788582106.986875:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582106.986878:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26c00, rc 0) 00000100:00100000:3.0:1788582106.986949:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+15:11287:x1875464002009728:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 1443us (2070us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788582106.986958:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 138 00000100:00100000:2.0:1788582106.990603:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582106.990639:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582106.990700:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002009856 00000100:00100000:1.0:1788582106.990710:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002009856 00000100:00100000:1.0:1788582106.991811:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 139 00000100:00100000:1.0:1788582106.991843:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+15:11287:x1875464002009856:12345-192.168.201.12@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788582106.991960:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+15:11287:x1875464002009856:12345-192.168.201.12@tcp:59:lhsmtool_posix.0 Request processed in 128us (1366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582106.991968:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 139 00000100:00100000:0.0:1788582106.991978:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002009984 00000100:00100000:0.0:1788582106.991983:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002009984 00000100:00100000:0.0:1788582106.992022:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 8 00000100:00100000:0.0:1788582106.992029:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+15:2352:x1875464002009984:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788582106.992039:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582106.992067:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7508 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92c2 expref: 15 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582106.992086:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d0d888de500) 00010000:00010000:0.0:1788582106.992091:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788582106.992115:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+14:2352:x1875464002009984:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 87us (1476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582106.992123:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 8 00000040:00080000:1.0:1788582107.568647:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788582107.568660:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788582107.568705:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:1.0:1788582107.568713:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788582107.885952:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582108.151680:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788582108.151703:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020888960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788582108.151788:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582108.151863:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020888960 00000100:00100000:2.0:1788582108.151872:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020888960 00000100:00100000:2.0:1788582108.151940:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788582108.151950:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020888960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788582108.151987:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788582108.152030:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020888960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582108.152053:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788582108.152099:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020888960:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788582108.152388:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788582108.920358:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582109.425991:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582109.426056:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002010112 00000100:00100000:3.0:1788582109.426066:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002010112 00000100:00100000:3.0:1788582109.426159:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 140 00000100:00100000:3.0:1788582109.426171:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+14:11329:x1875464002010112:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:3.0:1788582109.426192:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582109.426227:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7516 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c92c9 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426280:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a751d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426291:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a751d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426300:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a751d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426324:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a7524 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426329:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a7524 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426333:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a7524 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426520:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a751d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426525:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a751d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426529:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a751d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426533:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582109.426536:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a751d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426541:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a751d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426550:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d85afcc00) 00010000:00010000:3.0:1788582109.426552:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582109.426555:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a751d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426559:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a751d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426570:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a7524 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426574:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a7524 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426577:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a7524 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426580:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582109.426582:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a7524 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426585:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a7524 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426588:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d0d917bd600) 00010000:00010000:3.0:1788582109.426590:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582109.426591:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a7524 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426594:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a7524 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426616:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7516 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92c9 expref: 15 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426622:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d85afcc00) 00010000:00010000:3.0:1788582109.426624:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582109.426630:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7516 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92c9 expref: 15 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.426636:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26000, rc 0) 00000100:00100000:3.0:1788582109.426688:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+14:11329:x1875464002010112:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 520us (704us total) trans 0 rc 301/301 00000100:00100000:3.0:1788582109.426695:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 140 00000100:00080000:1.0:1788582109.426817:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788582109.432541:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582109.432796:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002010368 00000100:00100000:1.0:1788582109.432808:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002010368 00000100:00100000:1.0:1788582109.432865:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 141 00000100:00100000:1.0:1788582109.432876:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab98f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+14:11329:x1875464002010368:12345-192.168.201.12@tcp:36:lfs.0 00010000:00010000:1.0:1788582109.432933:0:10136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582109.432964:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a6e8d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90fb expref: 14 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582109.432982:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d85afcc00) 00010000:00010000:1.0:1788582109.432987:0:10136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788582109.433266:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a752b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582109.433283:0:10136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74ec lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92bb expref: 5 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582109.433294:0:10136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a752b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582109.433341:0:10136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92bb expref: 5 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582109.433356:0:10136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92bb expref: 5 pid: 5845 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582109.433373:0:10136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10136:1875464020889088:192.168.201.12@tcp:104: 00000100:00100000:1.0:1788582109.433474:0:10136:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c3540 going to sleep for 11 seconds 00000100:00100000:0.0:1788582109.442789:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582109.446304:0:10136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0d4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10136:1875464020889088:192.168.201.12@tcp:104: 00010000:00010000:1.0:1788582109.446327:0:10136:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a752b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582109.447005:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002010496 00000100:00100000:2.0:1788582109.447016:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002010496 00010000:00010000:2.0:1788582109.447085:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92bb expref: 6 pid: 5845 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582109.447123:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 63 00000100:00100000:2.0:1788582109.447134:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a85b5d8-11d7-4e00-8094-5ec4da71e638+6:2349:x1875464002010496:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788582109.447148:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582109.447155:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74ec lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92bb expref: 6 pid: 5845 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.447169:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74ec lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92bb expref: 6 pid: 5845 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.447191:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a74ec lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92bb expref: 6 pid: 5845 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.447223:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d85afcc00) 00010000:00010000:2.0:1788582109.447229:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a752b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.447239:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a752b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.447260:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a752b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.447283:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582109.447343:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb06d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2349:x1875464002010496:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 210us (4570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582109.447351:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 63 00010000:00010000:2.0:1788582109.447380:0:10136:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a752b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.447387:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a752b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.447410:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7532 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.447420:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7532 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.447428:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7532 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582109.448475:0:10136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788582109.448488:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a752b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.448497:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a752b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.448503:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a752b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.448521:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582109.448526:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a752b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.448534:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a752b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.448547:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d85afcc00) 00010000:00010000:2.0:1788582109.448550:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582109.448554:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a752b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.448559:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd000/0x2bc3aa892c3a752b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788582109.448579:0:10136:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001701aa80 reply state 00000000a9682ee2 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7532 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582109.448604:0:10136:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788582109.448683:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab98f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+15:11329:x1875464002010368:12345-192.168.201.12@tcp:36:lfs.0 Request processed in 15806us (16150us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1788582109.448692:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 141 00000100:00080000:3.0:1788582109.449389:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788582109.455243:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7532 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582109.455264:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7532 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582109.455275:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7532 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582109.455282:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582109.455289:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7532 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582109.455298:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7532 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582109.455335:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d0d85afc300) 00010000:00010000:1.0:1788582109.455338:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582109.455345:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7532 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582109.455351:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7532 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582109.535584:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582109.535626:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582109.535656:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582109.535696:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002010624 00000100:00100000:1.0:1788582109.535707:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002010624 00000100:00100000:1.0:1788582109.535769:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 290 00000100:00100000:1.0:1788582109.535781:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2349:x1875464002010624:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582109.535851:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2349:x1875464002010624:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 72us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582109.535859:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 290 00000100:00100000:3.0:1788582109.540354:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002010880 00000100:00100000:3.0:1788582109.540371:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002010880 00000100:00100000:3.0:1788582109.540478:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002010752 00000100:00100000:3.0:1788582109.540482:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002010752 00000100:00100000:3.0:1788582109.540515:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 67 00000100:00100000:3.0:1788582109.540528:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+6:2349:x1875464002010880:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582109.540576:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 68 00000100:00100000:0.0:1788582109.540586:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+5:2349:x1875464002010752:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582109.540617:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb05180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+6:2349:x1875464002010880:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 94us (4990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582109.540625:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 67 00000100:00080000:1.0:1788582109.540637:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788582109.540643:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788582109.552040:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb07800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+5:2349:x1875464002010752:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 11441us (16368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582109.552057:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 68 00000100:00100000:1.0:1788582109.553642:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582109.553732:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002011008 00000100:00100000:3.0:1788582109.553751:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002011008 00000100:00100000:3.0:1788582109.553812:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 142 00000100:00100000:3.0:1788582109.553822:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+14:11337:x1875464002011008:12345-192.168.201.12@tcp:101:lctl.0 00010000:00010000:3.0:1788582109.553845:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582109.553866:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7539 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c92d0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.553932:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a7540 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.553965:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a7540 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.553977:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a7540 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582109.554016:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788582109.554019:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788582109.554042:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a7540 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.554067:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7539 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92d0 expref: 16 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.554081:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a7540 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92d0 expref: 15 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.554089:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d917bd600) 00010000:00010000:3.0:1788582109.554092:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788582109.554095:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27c00, rc 0) 00000100:00100000:3.0:1788582109.554162:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+15:11337:x1875464002011008:12345-192.168.201.12@tcp:101:lctl.0 Request processed in 340us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582109.554169:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 142 00000100:00100000:3.0:1788582109.607775:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582109.607994:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002011136 00000100:00100000:0.0:1788582109.608007:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002011136 00000100:00100000:0.0:1788582109.608074:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 143 00000100:00100000:0.0:1788582109.608085:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+15:11343:x1875464002011136:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:0.0:1788582109.608107:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582109.608128:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7547 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c92d7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608193:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a754e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608264:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a754e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608275:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a754e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608290:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7555 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608297:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7555 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608302:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7555 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608411:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a755c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608420:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a755c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608427:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a755c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582109.608455:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788582109.608459:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788582109.608477:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a755c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608489:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a754e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608507:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a754e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608513:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a754e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608520:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088600 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582109.608524:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a754e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608532:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a754e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608544:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d917bd600) 00010000:00010000:0.0:1788582109.608547:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582109.608552:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a754e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608559:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a754e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608572:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7555 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608577:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7555 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608582:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7555 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608587:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582109.608597:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7555 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608602:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7555 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608610:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff8d0d888dee00) 00010000:00010000:0.0:1788582109.608612:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582109.608615:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7555 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608620:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7555 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608649:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7547 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92d7 expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608660:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a755c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92d7 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.608667:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:0.0:1788582109.608670:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788582109.608672:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7088a00, rc 0) 00000100:00100000:0.0:1788582109.608724:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+16:11343:x1875464002011136:12345-192.168.201.12@tcp:101:bash.0 Request processed in 641us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582109.608731:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 143 00000100:00100000:1.0:1788582109.622892:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582109.623320:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002011392 00000100:00100000:2.0:1788582109.623330:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002011392 00000100:00100000:2.0:1788582109.623418:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 144 00000100:00100000:2.0:1788582109.623427:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+16:11343:x1875464002011392:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:2.0:1788582109.623449:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582109.623473:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7563 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c92de expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.623612:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a756a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.623626:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a756a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.623637:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a756a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.623689:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7571 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.623697:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.623704:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788582109.624525:0:10136:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1788582109.624684:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7578 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.624694:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.624702:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7578 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.624737:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a756a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.624776:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a756a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.624782:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a756a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.624788:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04e00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582109.624791:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a756a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.624798:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a756a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.624810:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:2.0:1788582109.624812:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582109.624816:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a756a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.624822:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a756a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788582109.624834:0:10136:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008c639489 reply state 0000000014325dc6 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582109.624842:0:10136:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788582109.624873:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a7563 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92de expref: 19 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.624885:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7578 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92de expref: 18 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.624904:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d85afca00) 00010000:00010000:2.0:1788582109.624906:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788582109.624908:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04600, rc 0) 00000100:00100000:2.0:1788582109.624981:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+19:11343:x1875464002011392:12345-192.168.201.12@tcp:101:bash.0 Request processed in 1554us (2100us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788582109.624989:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 144 00000100:00100000:1.0:1788582109.629540:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582109.629809:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002011520 00000100:00100000:3.0:1788582109.629827:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002011520 00000100:00100000:3.0:1788582109.629906:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 47 00000100:00100000:3.0:1788582109.629920:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+5:2350:x1875464002011520:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:3.0:1788582109.629973:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582109.630007:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a7586 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c92e5 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788582109.630043:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788582109.630067:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=328s v=(0 0) 00010000:00010000:3.0:1788582109.630088:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582109.630099:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a7586 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92e5 expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.630126:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a7586 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92e5 expref: 6 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.630150:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26000, rc 0) 00000100:00100000:3.0:1788582109.630289:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+6:2350:x1875464002011520:12345-192.168.201.12@tcp:101:bash.0 Request processed in 373us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582109.630297:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 47 00010000:00010000:2.0:1788582109.630898:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.630909:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7571 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.630916:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7571 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.630922:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582109.630927:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7571 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.630935:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7571 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.630952:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d0d85afcc00) 00010000:00010000:2.0:1788582109.630955:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582109.630960:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7571 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.630966:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7571 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582109.635030:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582109.635119:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002011648 00000100:00100000:2.0:1788582109.635139:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002011648 00000100:00100000:2.0:1788582109.635198:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 48 00000100:00100000:2.0:1788582109.635249:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+6:11343:x1875464002011648:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:2.0:1788582109.635267:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582109.635287:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a758d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c92ec expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.635322:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a7586 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92e5 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.635331:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788582109.635335:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788582109.635340:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a758d lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92ec expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.635372:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a7586 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92e5 expref: 7 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.635384:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a7586 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92e5 expref: 7 pid: 6692 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582109.635397:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b34380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1875464020889216:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582109.635485:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da7129240 going to sleep for 11 seconds 00000100:00100000:2.0:1788582109.637896:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b34380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1875464020889216:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582109.637954:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a758d lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92ec expref: 7 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.637981:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04800, rc 0) 00000100:00100000:2.0:1788582109.638051:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb04a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+7:11343:x1875464002011648:12345-192.168.201.12@tcp:101:bash.0 Request processed in 2803us (3029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582109.638062:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 48 00000100:00100000:1.0:1788582109.641340:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582109.641434:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002011776 00000100:00100000:3.0:1788582109.641445:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002011776 00010000:00010000:3.0:1788582109.641487:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a7586 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92e5 expref: 7 pid: 6692 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582109.641531:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 64 00000100:00100000:3.0:1788582109.641542:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+7:2349:x1875464002011776:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582109.641555:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582109.641586:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a7586 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92e5 expref: 7 pid: 6692 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.641600:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a7586 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92e5 expref: 7 pid: 6692 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.641621:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a7586 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92e5 expref: 7 pid: 6692 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.641639:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582109.641643:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582109.641652:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a758d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92ec expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.641660:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a758d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92ec expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.641699:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a758d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92ec expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582109.641713:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabdd1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1875464020889344:192.168.201.12@tcp:105: 00000100:00100000:3.0:1788582109.641808:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d84cfd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788582109.645024:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabdd1180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1875464020889344:192.168.201.12@tcp:105: 00010000:00010000:3.0:1788582109.645054:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582109.645150:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+6:2349:x1875464002011776:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 3608us (3819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582109.645178:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 64 00000100:00100000:1.0:1788582109.647464:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582109.647552:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002012032 00000100:00100000:2.0:1788582109.647562:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002012032 00000100:00100000:2.0:1788582109.647627:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 36 00000100:00100000:2.0:1788582109.647638:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+18:11343:x1875464002012032:12345-192.168.201.12@tcp:35:bash.0 00000100:00100000:2.0:1788582109.648045:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+19:11343:x1875464002012032:12345-192.168.201.12@tcp:35:bash.0 Request processed in 407us (587us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788582109.648053:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 36 00000001:00080000:3.0:1788582109.767561:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967418 is committed 00000100:00100000:2.0:1788582109.772304:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582109.772395:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002012288 00000100:00100000:0.0:1788582109.772405:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002012288 00000100:00100000:0.0:1788582109.772468:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 145 00000100:00100000:0.0:1788582109.772495:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+15:11353:x1875464002012288:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:0.0:1788582109.772523:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582109.772549:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7594 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c92f3 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582109.772645:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788582109.772905:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7594 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92f3 expref: 17 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.772921:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d917bd600) 00010000:00010000:0.0:1788582109.772924:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788582109.772929:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7594 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92f3 expref: 17 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.772942:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7088600, rc 0) 00000100:00100000:0.0:1788582109.773013:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+16:11353:x1875464002012288:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 520us (719us total) trans 4294967419 rc 301/301 00000100:00100000:0.0:1788582109.773020:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 145 00000100:00100000:3.0:1788582109.777488:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582109.777619:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002012544 00000100:00100000:0.0:1788582109.777632:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002012544 00000100:00100000:0.0:1788582109.777720:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 37 00000100:00100000:0.0:1788582109.777735:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+16:11353:x1875464002012544:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:0.0:1788582109.778037:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+17:11353:x1875464002012544:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 306us (562us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788582109.778046:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 37 00000100:00100000:3.0:1788582109.860279:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582109.865114:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002012672 00000100:00100000:2.0:1788582109.865255:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002012672 00000100:00100000:2.0:1788582109.865563:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 146 00000100:00100000:2.0:1788582109.865576:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+17:11359:x1875464002012672:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:2.0:1788582109.865605:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582109.865628:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a75a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c92fa expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.866044:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a75a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.866062:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a75a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.866090:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a75a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582109.866131:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788582109.866135:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788582109.866277:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a75a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.866312:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a75a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92fa expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.866331:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a75a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92fa expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.866341:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:2.0:1788582109.866411:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788582109.866415:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04a00, rc 0) 00000100:00100000:3.0:1788582109.866933:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+18:11359:x1875464002012672:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 1355us (6661us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582109.867000:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 146 00000100:00100000:1.0:1788582109.870914:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582109.871070:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002012928 00000100:00100000:2.0:1788582109.871082:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002012928 00000100:00100000:2.0:1788582109.871170:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 147 00000100:00100000:2.0:1788582109.871182:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+18:11359:x1875464002012928:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:2.0:1788582109.875455:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582109.875502:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a75b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9301 expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.875638:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a75b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.875671:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a75b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.875683:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a75b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582109.875695:0:10136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788582109.876541:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a75b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9301 expref: 21 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.876567:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a75b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9301 expref: 20 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.876576:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d85afca00) 00010000:00010000:2.0:1788582109.876579:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788582109.876582:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05200, rc 0) 00000100:00100000:2.0:1788582109.877605:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+20:11359:x1875464002012928:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 5480us (5870us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1788582109.877618:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 147 00000100:00100000:0.0:1788582109.891524:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582109.891602:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582109.891698:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002013312 00000100:00100000:2.0:1788582109.891708:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002013312 00000100:00100000:2.0:1788582109.891785:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 9 00000100:00100000:2.0:1788582109.891804:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99087a3-3c83-4416-b2b9-d522b9885111+20:2349:x1875464002013312:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788582109.891820:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582109.891845:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a75b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9301 expref: 20 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.891875:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d85afca00) 00010000:00010000:2.0:1788582109.891880:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582109.891944:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb6a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99087a3-3c83-4416-b2b9-d522b9885111+19:2349:x1875464002013312:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 142us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582109.891952:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 9 00000100:00100000:3.0:1788582109.892074:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002013184 00000100:00100000:3.0:1788582109.892078:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002013184 00000100:00100000:3.0:1788582109.892115:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 148 00000100:00100000:3.0:1788582109.892122:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+19:11359:x1875464002013184:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:3.0:1788582109.892142:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582109.892156:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a75c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9308 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.892280:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a75cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.892294:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a75cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.892305:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a75cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582109.892319:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788582109.892463:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a75c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9308 expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.892491:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a75cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9308 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.892498:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d85afca00) 00010000:00010000:3.0:1788582109.892501:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788582109.892503:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26200, rc 0) 00000100:00100000:3.0:1788582109.892527:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb06300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+21:11359:x1875464002013184:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 406us (1013us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788582109.892533:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 148 00000100:00100000:1.0:1788582109.909096:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582109.909542:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002013440 00000100:00100000:3.0:1788582109.909553:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002013440 00000100:00100000:3.0:1788582109.909620:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 49 00000100:00100000:3.0:1788582109.909630:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+6:2351:x1875464002013440:12345-192.168.201.12@tcp:1:lfs.0 00010000:00010000:3.0:1788582109.909676:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a75da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.909698:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a758d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92ec expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.909706:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582109.909711:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788582109.909715:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a75da lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.909786:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a758d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92ec expref: 6 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.909895:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a758d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92ec expref: 6 pid: 6693 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582109.909910:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1875464020889472:192.168.201.12@tcp:104: 00000100:00100000:3.0:1788582109.910054:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8da000 going to sleep for 11 seconds 00000100:00100000:1.0:1788582109.926516:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582109.926675:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002013568 00000100:00100000:2.0:1788582109.926685:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002013568 00002000:00100000:2.0:1788582109.926757:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8d0dac0d5c00 x1875464002013568/t0(0) o4->b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp:710/0 lens 504/0 e 0 to 0 dl 1788582120 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788582109.926769:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0dac0d5c00 with x1875464002013568 ext(0->12) 00010000:00010000:2.0:1788582109.926780:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a758d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92ec expref: 7 pid: 6693 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.926806:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a758d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92ec expref: 7 pid: 6693 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788582109.926814:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d0dac0d5c00 00000100:00100000:2.0:1788582109.926847:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 2 00000100:00100000:2.0:1788582109.926856:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b99087a3-3c83-4416-b2b9-d522b9885111+7:2350:x1875464002013568:12345-192.168.201.12@tcp:4:lfs.0 00000100:00100000:2.0:1788582109.927511:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b99087a3-3c83-4416-b2b9-d522b9885111+9:2350:x1875464002013568:12345-192.168.201.12@tcp:4:lfs.0 Request processed in 652us (1002us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1788582109.927520:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 2 00002000:00100000:2.0:1788582109.927528:0:6698:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff8d0dac0d5c00 x1875464002013568/t4294967305(0) o4->b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp:710/0 lens 504/448 e 0 to 0 dl 1788582120 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788582109.927548:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0dac0d5c00 with x1875464002013568 ext(0->12) 00010000:00010000:2.0:1788582109.927554:0:6698:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a758d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92ec expref: 9 pid: 6693 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.927566:0:6698:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a758d lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92ec expref: 9 pid: 6693 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788582109.927573:0:6698:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d0dac0d5c00 00000100:00100000:3.0:1788582109.927670:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38dc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6692:1875464020889472:192.168.201.12@tcp:104: 00010000:00010000:3.0:1788582109.927695:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a75da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582109.934135:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582109.934248:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002013696 00000100:00100000:0.0:1788582109.934259:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002013696 00010000:00010000:0.0:1788582109.934300:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a758d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92ec expref: 9 pid: 6693 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582109.934352:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 65 00000100:00100000:0.0:1788582109.934364:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+9:2352:x1875464002013696:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788582109.934381:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788582109.934402:0:7636:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788582109.934405:0:7636:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788582109 00002000:00010000:0.0:1788582109.934408:0:7636:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788582109 00002000:00010000:0.0:1788582109.934410:0:7636:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788582109 00010000:00010000:0.0:1788582109.934416:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a758d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92ec expref: 9 pid: 6693 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.934431:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a758d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92ec expref: 9 pid: 6693 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.934457:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000594ac0f8/0x2bc3aa892c3a758d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92ec expref: 9 pid: 6693 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.934475:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788582109.934479:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788582109.934486:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a75da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.934519:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a75da lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.934550:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788582109.934605:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+8:2352:x1875464002013696:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 243us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582109.934614:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 65 00010000:00010000:3.0:1788582109.935877:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582109.935909:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a75da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.935921:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a75da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.935955:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a75da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.935964:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a75da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.935972:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a75da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.935998:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26000 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:3.0:1788582109.936003:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a75da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.936012:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a75da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.936026:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a75da lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.936033:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000084a299f0/0x2bc3aa892c3a75da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582109.936115:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+7:2351:x1875464002013440:12345-192.168.201.12@tcp:1:lfs.0 Request processed in 26483us (27030us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582109.936124:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 49 00000100:00100000:1.0:1788582109.940235:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582109.940354:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002013952 00000100:00100000:0.0:1788582109.940365:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002013952 00000100:00100000:0.0:1788582109.940431:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 38 00000100:00100000:0.0:1788582109.940442:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d84eccc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+21:11359:x1875464002013952:12345-192.168.201.12@tcp:35:lfs.0 00000004:00010000:0.0:1788582109.940514:0:10138:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a75cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9308 expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788582109.940987:0:10138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1788582109.941048:0:10138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1788582109.946449:0:10138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1788582109.946602:0:10138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a75e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.946627:0:10138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7578 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92de expref: 25 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.946636:0:10138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a75e1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.946678:0:10138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7578 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92de expref: 25 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.946708:0:10138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7578 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92de expref: 25 pid: 10136 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582109.946724:0:10138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabb68a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:10138:1875464020889600:192.168.201.12@tcp:104: 00000100:00100000:0.0:1788582109.947554:0:10138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbf75f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788582109.953866:0:10138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabb68a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:10138:1875464020889600:192.168.201.12@tcp:104: 00010000:00010000:0.0:1788582109.953902:0:10138:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a75e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582109.956454:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582109.956775:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002014080 00000100:00100000:2.0:1788582109.956786:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002014080 00010000:00010000:2.0:1788582109.956835:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7578 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92de expref: 26 pid: 10136 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582109.956878:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 66 00000100:00100000:2.0:1788582109.956889:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da7244050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99087a3-3c83-4416-b2b9-d522b9885111+26:2349:x1875464002014080:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788582109.956905:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582109.956913:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7578 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92de expref: 26 pid: 10136 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.956928:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7578 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92de expref: 26 pid: 10136 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.956954:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7578 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92de expref: 26 pid: 10136 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.956973:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d85afca00) 00010000:00010000:2.0:1788582109.956993:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a75e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.957003:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a75e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.957012:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a75e1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582109.957547:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582109.957607:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da7244050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99087a3-3c83-4416-b2b9-d522b9885111+25:2349:x1875464002014080:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 717us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582109.957615:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 66 00010000:00010000:3.0:1788582109.961603:0:10138:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a75e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.961622:0:10138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a75e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788582109.961893:0:10138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:2.0:1788582109.962155:0:10138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:2.0:1788582109.962310:0:10138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b35c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:10138:1875464020889728:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:2.0:1788582109.962391:0:10138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582109.962435:0:10138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8a38fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1788582109.963531:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020889728 00000100:00100000:1.0:1788582109.963542:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020889728 00000100:00100000:1.0:1788582109.963603:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788582109.963613:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10138:x1875464020889728:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1788582109.963712:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10138:x1875464020889728:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 100us (1321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582109.963721:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788582109.963881:0:10138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b35c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:10138:1875464020889728:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1788582109.964634:0:10138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1788582109.964712:0:10138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabb68a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:10138:1875464020889856:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1788582109.964769:0:10138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582109.964793:0:10138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbf75fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788582109.965147:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020889856 00000100:00100000:1.0:1788582109.965154:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020889856 00000100:00100000:1.0:1788582109.965185:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788582109.965193:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:10138:x1875464020889856:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1788582109.965421:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:10138:x1875464020889856:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 229us (651us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1788582109.965429:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788582109.965959:0:10138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabb68a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:10138:1875464020889856:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1788582109.966022:0:10138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1788582109.966069:0:10138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a75e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.966080:0:10138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a75e1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.966089:0:10138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a75e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.966095:0:10138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582109.966112:0:10138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a75e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.966444:0:10138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a75e1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.966464:0:10138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d85afca00) 00010000:00010000:0.0:1788582109.966467:0:10138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788582109.966472:0:10138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a75e1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582109.966479:0:10138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a75e1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788582109.966694:0:10138:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788582109.966874:0:10138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1788582109.966887:0:10138:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 328960684319ns, next at 329960681756ns, rc = 0 00000001:00080000:0.0:1788582109.966895:0:10138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1788582109.966934:0:10138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d85afca00) 00010000:00010000:0.0:1788582109.966937:0:10138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788582109.966945:0:10138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a75cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9308 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582109.967061:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d84eccc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+28:11359:x1875464002013952:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 26620us (26867us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1788582109.967070:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 38 00000020:00080000:0.0:1788582109.967074:0:10138:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788582109.980558:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582109.980900:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002014208 00000100:00100000:3.0:1788582109.980911:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002014208 00000100:00100000:3.0:1788582109.980976:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 149 00000100:00100000:3.0:1788582109.980987:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+28:11359:x1875464002014208:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:3.0:1788582109.981025:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582109.981048:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a75e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c930f expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.981108:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a75e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c930f expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.981123:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a75e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c930f expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582109.981143:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:3.0:1788582109.981156:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788582109.981162:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26000, rc 0) 00000100:00100000:3.0:1788582109.981242:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+29:11359:x1875464002014208:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 256us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582109.981250:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 149 00000100:00100000:1.0:1788582110.005037:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582110.005391:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002014464 00000100:00100000:3.0:1788582110.005403:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002014464 00000100:00100000:3.0:1788582110.005469:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 39 00000100:00100000:3.0:1788582110.005480:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+29:11359:x1875464002014464:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:3.0:1788582110.010571:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+30:11359:x1875464002014464:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 5076us (5534us total) trans 4294967432 rc 0/0 00000100:00100000:3.0:1788582110.010588:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 39 00000100:00100000:1.0:1788582110.151099:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582110.151243:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002014720 00000100:00100000:2.0:1788582110.151254:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002014720 00000100:00100000:2.0:1788582110.151318:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 150 00000100:00100000:2.0:1788582110.151329:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+30:11369:x1875464002014720:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:2.0:1788582110.151356:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582110.151378:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a75ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9316 expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582110.151469:0:10136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788582110.151590:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a75ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9316 expref: 32 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.151621:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d917bd600) 00010000:00010000:2.0:1788582110.151624:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788582110.151630:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a75ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9316 expref: 32 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.151644:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04600, rc 0) 00000100:00100000:2.0:1788582110.151822:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+31:11369:x1875464002014720:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 493us (732us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1788582110.151830:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 150 00000100:00100000:0.0:1788582110.162848:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582110.162999:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002014848 00000100:00100000:2.0:1788582110.163010:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002014848 00000100:00100000:2.0:1788582110.163086:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 151 00000100:00100000:2.0:1788582110.163103:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+31:11369:x1875464002014848:12345-192.168.201.12@tcp:34:lfs.0 00010000:00010000:2.0:1788582110.163190:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a75fd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163233:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a75fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163248:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a75fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163264:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7604 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163272:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163296:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163527:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a760b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163536:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a760b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163543:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a760b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788582110.163582:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a760b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163594:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a75fd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163601:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a75fd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163607:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a75fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163613:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04600 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582110.163617:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a75fd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163624:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a75fd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163636:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:2.0:1788582110.163644:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582110.163649:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a75fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163655:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a75fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163667:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7604 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163674:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7604 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163680:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7604 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163685:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582110.163688:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7604 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163695:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7604 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163701:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d0d85afcc00) 00010000:00010000:2.0:1788582110.163704:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582110.163707:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7604 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163713:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7604 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163726:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a760b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163751:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a760b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163757:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a760b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163762:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582110.163765:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a760b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163772:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a760b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163780:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:2.0:1788582110.163783:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582110.163786:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a760b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.163792:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a760b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582110.163868:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+31:11369:x1875464002014848:12345-192.168.201.12@tcp:34:lfs.0 Request processed in 772us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582110.163877:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 151 00000100:00100000:1.0:1788582110.171177:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582110.171305:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002015104 00000100:00100000:0.0:1788582110.171316:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002015104 00000100:00100000:0.0:1788582110.171400:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 40 00000100:00100000:0.0:1788582110.171411:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+31:11369:x1875464002015104:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:0.0:1788582110.171655:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+32:11369:x1875464002015104:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 245us (493us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1788582110.171664:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 40 00000100:00100000:1.0:1788582110.222993:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582110.223106:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002015360 00000100:00100000:0.0:1788582110.223116:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002015360 00000100:00100000:0.0:1788582110.223190:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 152 00000100:00100000:0.0:1788582110.223226:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+32:11372:x1875464002015360:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:0.0:1788582110.223254:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582110.223278:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7612 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c931d expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.223359:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7619 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.223374:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7619 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.223385:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7619 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.223398:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7620 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.223405:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.223411:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.223706:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7627 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.223716:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.223725:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582110.223748:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788582110.223854:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7619 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.223862:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7619 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.223868:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7619 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.223874:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582110.223879:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7619 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.223886:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7619 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.223898:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:0.0:1788582110.223901:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582110.223907:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7619 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.223925:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7619 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.223940:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.223946:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7620 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.223952:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.223957:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088600 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582110.223960:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.223966:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7620 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.223973:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d0d888dee00) 00010000:00010000:0.0:1788582110.223975:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582110.223978:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7620 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.223983:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7620 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.224027:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7612 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c931d expref: 35 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.224057:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7627 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c931d expref: 34 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.224064:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:0.0:1788582110.224066:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788582110.224068:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7089c00, rc 0) 00000100:00100000:0.0:1788582110.224147:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+34:11372:x1875464002015360:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 947us (1165us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788582110.224156:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 152 00000100:00100000:1.0:1788582110.235153:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582110.235241:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002015488 00000100:00100000:2.0:1788582110.235251:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002015488 00000100:00100000:2.0:1788582110.235315:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 153 00000100:00100000:2.0:1788582110.235326:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+34:11372:x1875464002015488:12345-192.168.201.12@tcp:54:lfs.0 00010000:00010000:2.0:1788582110.235401:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7635 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.235433:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.235446:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.235473:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7635 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.235481:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7635 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.235488:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7635 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.235494:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582110.235499:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7635 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.235507:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7635 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.235519:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:2.0:1788582110.235522:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788582110.235527:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7635 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.235533:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7635 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582110.235604:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+34:11372:x1875464002015488:12345-192.168.201.12@tcp:54:lfs.0 Request processed in 279us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582110.235617:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 153 00000100:00100000:1.0:1788582110.239050:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582110.239168:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002015744 00000100:00100000:0.0:1788582110.239179:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002015744 00000100:00100000:0.0:1788582110.239273:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 41 00000100:00100000:0.0:1788582110.239285:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+34:11372:x1875464002015744:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:0.0:1788582110.239525:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+35:11372:x1875464002015744:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 241us (484us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1788582110.239534:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 41 00000100:00100000:1.0:1788582110.489301:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582110.495548:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002016000 00000100:00100000:3.0:1788582110.495564:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002016000 00000100:00100000:0.0:1788582110.495929:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 154 00000100:00100000:0.0:1788582110.495945:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+35:11403:x1875464002016000:12345-192.168.201.12@tcp:101:cat.0 00010000:00010000:0.0:1788582110.495972:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582110.495996:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a763c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9324 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.496155:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7643 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.496194:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.496239:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7643 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582110.496253:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788582110.496557:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a763c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9324 expref: 38 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.496578:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7643 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9324 expref: 37 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.496586:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:0.0:1788582110.496589:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788582110.496592:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7088600, rc 0) 00000100:00100000:0.0:1788582110.496893:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+37:11403:x1875464002016000:12345-192.168.201.12@tcp:101:cat.0 Request processed in 951us (7600us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1788582110.496900:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 154 00000100:00100000:1.0:1788582110.517408:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582110.518004:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582110.518056:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002016384 00000100:00100000:3.0:1788582110.518066:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002016384 00000100:00100000:3.0:1788582110.518570:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 42 00000100:00100000:3.0:1788582110.518581:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+37:11403:x1875464002016384:12345-192.168.201.12@tcp:35:cat.0 00000100:00100000:3.0:1788582110.518880:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+38:11403:x1875464002016384:12345-192.168.201.12@tcp:35:cat.0 Request processed in 300us (877us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1788582110.518888:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 42 00000100:00100000:0.0:1788582110.518955:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002016128 00000100:00100000:0.0:1788582110.518961:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002016128 00000100:00100000:0.0:1788582110.519000:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 10 00000100:00100000:0.0:1788582110.519009:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+38:2350:x1875464002016128:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788582110.519020:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582110.519050:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7643 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9324 expref: 38 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.519080:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:0.0:1788582110.519085:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788582110.519105:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+37:2350:x1875464002016128:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 98us (1781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582110.519112:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 10 00000100:00100000:1.0:1788582110.620002:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582110.620647:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002016640 00000100:00100000:3.0:1788582110.620664:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002016640 00000100:00100000:3.0:1788582110.620750:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 155 00000100:00100000:3.0:1788582110.620761:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+37:11409:x1875464002016640:12345-192.168.201.12@tcp:101:dd.0 00010000:00010000:3.0:1788582110.620787:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582110.620790:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788582110.620817:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a75a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92fa expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582110.620838:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:3.0:1788582110.620843:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788582110.620858:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7651 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c932b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582110.620964:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7658 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582110.620978:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7627 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c931d expref: 37 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582110.620987:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7658 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582110.621040:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7627 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c931d expref: 37 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582110.621053:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7627 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c931d expref: 37 pid: 10137 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582110.621066:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875464020889984:192.168.201.12@tcp:104: 00000100:00100000:3.0:1788582110.621178:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8daf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788582110.626051:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875464020889984:192.168.201.12@tcp:104: 00010000:00010000:3.0:1788582110.626095:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7658 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582110.626991:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582110.627101:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002016768 00000100:00100000:0.0:1788582110.627110:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002016768 00010000:00010000:0.0:1788582110.627156:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7627 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c931d expref: 38 pid: 10137 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582110.627231:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 67 00000100:00100000:0.0:1788582110.627242:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+38:2350:x1875464002016768:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788582110.627257:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582110.627265:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7627 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c931d expref: 38 pid: 10137 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.627278:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7627 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c931d expref: 38 pid: 10137 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.627302:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7627 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c931d expref: 38 pid: 10137 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.627319:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:0.0:1788582110.627324:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7658 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.627522:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7658 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.627530:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7658 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582110.627561:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788582110.627611:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+37:2350:x1875464002016768:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 370us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582110.627619:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 67 00010000:00010000:3.0:1788582110.627688:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7658 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582110.627695:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7658 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582110.627716:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788582110.627912:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7651 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c932b expref: 38 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582110.627928:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7658 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c932b expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582110.627935:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:3.0:1788582110.627937:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788582110.627946:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26400, rc 0) 00000100:00100000:3.0:1788582110.627973:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc08380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+37:11409:x1875464002016640:12345-192.168.201.12@tcp:101:dd.0 Request processed in 7214us (7984us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1788582110.627980:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 155 00000100:00100000:2.0:1788582110.636044:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582110.636437:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002017024 00000100:00100000:3.0:1788582110.636449:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002017024 00000100:00100000:3.0:1788582110.636510:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 156 00000100:00100000:3.0:1788582110.636521:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+37:11409:x1875464002017024:12345-192.168.201.12@tcp:36:dd.0 00010000:00010000:3.0:1788582110.636809:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7666 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582110.636826:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7666 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582110.636837:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7666 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788582110.636892:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:3.0:1788582110.636917:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005ad44e2a reply state 00000000178d757f transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7666 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582110.636926:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788582110.637027:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+40:11409:x1875464002017024:12345-192.168.201.12@tcp:36:dd.0 Request processed in 507us (995us total) trans 4294967441 rc 0/0 00000100:00100000:3.0:1788582110.637035:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 156 00000020:00080000:3.0:1788582110.637040:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788582110.646977:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7666 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582110.646999:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7666 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582110.647027:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7666 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582110.647033:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582110.647039:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7666 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582110.647047:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7666 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582110.647066:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:3.0:1788582110.647069:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582110.647075:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7666 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582110.647081:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7666 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582110.958288:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582111.110299:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582111.110398:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002017152 00000100:00100000:3.0:1788582111.110409:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002017152 00000100:00100000:3.0:1788582111.110482:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 157 00000100:00080000:2.0:1788582111.110515:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788582111.110550:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+39:11424:x1875464002017152:12345-192.168.201.12@tcp:101:stat.0 00010000:00010000:3.0:1788582111.110576:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582111.110598:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a766d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9332 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.110678:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7674 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.110692:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7674 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.110733:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7674 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.110756:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a767b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.110763:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a767b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.110769:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a767b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.111015:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7682 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.111027:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7658 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c932b expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.111035:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7682 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.111179:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7658 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c932b expref: 40 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.111194:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7658 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c932b expref: 40 pid: 5843 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582111.111240:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac38dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875464020890112:192.168.201.12@tcp:104: 00000100:00100000:3.0:1788582111.111334:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8da9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788582111.113343:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582111.113394:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002017408 00000100:00100000:2.0:1788582111.113404:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002017408 00000100:00100000:0.0:1788582111.113444:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac38dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875464020890112:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582111.113467:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 43 00010000:00010000:0.0:1788582111.113470:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7682 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582111.113476:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+41:5586:x1875464002017408:12345-192.168.201.12@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1788582111.114036:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+42:5586:x1875464002017408:12345-192.168.201.12@tcp:35:ldlm_bl.0 Request processed in 557us (700us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1788582111.114358:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 43 00000100:00100000:0.0:1788582111.116599:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582111.116816:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002017536 00000100:00100000:2.0:1788582111.116826:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002017536 00010000:00010000:2.0:1788582111.116866:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7658 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c932b expref: 42 pid: 5843 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582111.116956:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 68 00000100:00100000:2.0:1788582111.116966:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+42:2350:x1875464002017536:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788582111.116986:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582111.116993:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7658 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c932b expref: 42 pid: 5843 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582111.117006:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7658 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c932b expref: 42 pid: 5843 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582111.117058:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7658 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c932b expref: 42 pid: 5843 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582111.117084:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:2.0:1788582111.117089:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7682 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582111.117098:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582111.117105:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7682 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582111.117136:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582111.117193:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+41:2350:x1875464002017536:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 228us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582111.117237:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 68 00010000:00010000:0.0:1788582111.119373:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.119389:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582111.119442:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788582111.119447:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788582111.119492:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.119507:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7682 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.119517:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7674 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.119539:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7674 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.119546:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7674 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.119552:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582111.119556:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7674 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.119562:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7674 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.119576:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:0.0:1788582111.119579:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582111.119584:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7674 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.119589:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7674 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.119605:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a767b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.119610:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a767b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.119616:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a767b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.119620:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582111.119638:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a767b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.119644:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a767b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.119651:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d0d917bde00) 00010000:00010000:0.0:1788582111.119654:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582111.119657:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a767b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.119663:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a767b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.119714:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a766d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9332 expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.119737:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7682 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9332 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.119746:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:0.0:1788582111.119748:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788582111.119751:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26200, rc 0) 00000100:00100000:0.0:1788582111.119848:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+40:11424:x1875464002017152:12345-192.168.201.12@tcp:101:stat.0 Request processed in 9300us (9558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582111.119858:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 157 00000100:00100000:0.0:1788582111.235389:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582111.235475:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002017792 00000100:00100000:3.0:1788582111.235485:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002017792 00000100:00100000:3.0:1788582111.235546:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 158 00000100:00100000:3.0:1788582111.235556:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+40:11430:x1875464002017792:12345-192.168.201.12@tcp:36:truncate.0 00010000:00010000:3.0:1788582111.235616:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582111.235643:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7682 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9332 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.235677:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:3.0:1788582111.235682:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788582111.235894:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7689 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.235908:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.235917:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788582111.235984:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:3.0:1788582111.236009:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ec187c66 reply state 000000004987a7c2 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582111.236018:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788582111.236383:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+42:11430:x1875464002017792:12345-192.168.201.12@tcp:36:truncate.0 Request processed in 824us (1000us total) trans 4294967444 rc 0/0 00000100:00100000:3.0:1788582111.236391:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 158 00000020:00080000:3.0:1788582111.236397:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788582111.243497:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582111.243516:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7689 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582111.243524:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7689 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582111.243530:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582111.243535:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7689 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582111.243563:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7689 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582111.243580:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:2.0:1788582111.243583:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582111.243589:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7689 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582111.243594:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7689 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582111.515130:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582111.515316:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002017920 00000100:00100000:3.0:1788582111.515346:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002017920 00000100:00100000:3.0:1788582111.515425:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 159 00000100:00100000:3.0:1788582111.515436:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+41:11444:x1875464002017920:12345-192.168.201.12@tcp:101:stat.0 00010000:00010000:3.0:1788582111.515463:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582111.515491:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7690 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9339 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.515569:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7697 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.515585:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7697 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.515597:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7697 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.515613:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a769e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.515620:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a769e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.515626:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a769e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.516017:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a76a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.516027:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a76a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.516035:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a76a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582111.516082:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1788582111.516086:0:10137:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788582111.516445:0:10137:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a76a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.516459:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a76a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.516470:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7697 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.516476:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7697 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.516484:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7697 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.516491:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582111.516495:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7697 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.516502:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7697 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.516515:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:3.0:1788582111.516519:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582111.516523:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7697 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.516529:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7697 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.516553:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a769e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.516558:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a769e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.516564:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a769e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.516569:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582111.516572:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a769e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.516578:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a769e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.516585:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d0d917bdb00) 00010000:00010000:3.0:1788582111.516588:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582111.516590:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a769e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.516595:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a769e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.516632:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7690 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9339 expref: 43 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.516647:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a76a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9339 expref: 42 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.516665:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:3.0:1788582111.516668:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788582111.516671:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27200, rc 0) 00000100:00100000:3.0:1788582111.517583:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+42:11444:x1875464002017920:12345-192.168.201.12@tcp:101:stat.0 Request processed in 2141us (2455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582111.517593:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 159 00000100:00100000:1.0:1788582111.682722:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582111.682901:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002018176 00000100:00100000:0.0:1788582111.682912:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002018176 00000100:00100000:0.0:1788582111.683010:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 160 00000100:00100000:0.0:1788582111.683022:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+42:11454:x1875464002018176:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:0.0:1788582111.683046:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582111.683077:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a76ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9340 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582111.683239:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788582111.683371:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a76ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9340 expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.683386:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d917bd600) 00010000:00010000:0.0:1788582111.683388:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788582111.683394:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a76ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9340 expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.683408:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7089800, rc 0) 00000100:00100000:0.0:1788582111.683477:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c16a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+43:11454:x1875464002018176:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 457us (777us total) trans 4294967445 rc 301/301 00000100:00100000:0.0:1788582111.683485:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 160 00000100:00100000:0.0:1788582111.686354:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582111.686437:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002018432 00000100:00100000:3.0:1788582111.686448:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002018432 00000100:00100000:3.0:1788582111.686513:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 44 00000100:00100000:3.0:1788582111.686523:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d84ecd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+43:11454:x1875464002018432:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:3.0:1788582111.686779:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d84ecd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+44:11454:x1875464002018432:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 256us (437us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788582111.686788:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 44 00000100:00100000:0.0:1788582111.725653:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020890624:0@lo:400:kworker.0 00000100:00100000:0.0:1788582111.725761:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582111.725840:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788582111.725847:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020890240:0@lo:400:kworker.0 00000100:00100000:0.0:1788582111.725876:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582111.725900:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020890752:0@lo:400:kworker.0 00000100:00100000:0.0:1788582111.725948:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582111.725979:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020890240 00000100:00100000:0.0:1788582111.725988:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020890240 00000100:00100000:0.0:1788582111.726042:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788582111.726053:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020890240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582111.726127:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020890240:12345-0@lo:400:kworker.0 Request processed in 75us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582111.726133:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:0.0:1788582111.726179:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020890240:0@lo:400:kworker.0 00000100:00100000:3.0:1788582111.726350:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020890624 00000100:00100000:3.0:1788582111.726355:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020890624 00000100:00100000:3.0:1788582111.726394:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788582111.726403:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875464020890624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582111.726446:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3308:x1875464020890624:12345-0@lo:400:kworker.0 Request processed in 46us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582111.726452:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788582111.726481:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020890624:0@lo:400:kworker.0 00000100:00100000:2.0:1788582111.726561:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020890368:0@lo:400:kworker.0 00000100:00100000:2.0:1788582111.726592:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582111.726622:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabc09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020890880:0@lo:400:kworker.0 00000100:00100000:2.0:1788582111.726644:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582111.726665:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788582111.726671:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020890496:0@lo:400:kworker.0 00000100:00100000:2.0:1788582111.726690:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582111.726727:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020890880 00000100:00100000:2.0:1788582111.726731:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020890880 00000100:00100000:2.0:1788582111.726758:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788582111.726765:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020890880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582111.726804:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac141180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020890880:12345-0@lo:400:kworker.0 Request processed in 40us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582111.726811:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788582111.726839:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabc09f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020890880:0@lo:400:kworker.0 00000100:00100000:2.0:1788582111.726859:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020890752 00000100:00100000:2.0:1788582111.726872:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020890752 00000100:00100000:2.0:1788582111.726900:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020890368 00000100:00100000:2.0:1788582111.726903:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020890368 00000100:00100000:2.0:1788582111.726918:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020890496 00000100:00100000:2.0:1788582111.726920:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020890496 00000100:00100000:2.0:1788582111.726934:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788582111.726941:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020890752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582111.726991:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020890752:12345-0@lo:400:kworker.0 Request processed in 51us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582111.726998:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788582111.727010:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788582111.727016:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020890368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582111.727047:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020890368:12345-0@lo:400:kworker.0 Request processed in 31us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582111.727052:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788582111.727064:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788582111.727069:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020890496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582111.727108:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac142d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020890496:12345-0@lo:400:kworker.0 Request processed in 39us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582111.727114:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788582111.727137:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020890496:0@lo:400:kworker.0 00000100:00100000:2.0:1788582111.727147:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020890368:0@lo:400:kworker.0 00000100:00100000:3.0:1788582111.727293:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020890752:0@lo:400:kworker.0 00000100:00100000:1.0:1788582111.727578:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020891008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788582111.727610:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582111.727662:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020891008 00000100:00100000:1.0:1788582111.727666:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020891008 00000100:00100000:1.0:1788582111.727697:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788582111.727704:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020891008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788582111.727750:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788582111.727791:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c15180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020891008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582111.727797:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788582111.727829:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90c15f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020891008:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788582111.728062:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788582111.728068:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788582111.728071:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788582111.778977:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582111.779143:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002018688 00000100:00100000:2.0:1788582111.779155:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002018688 00000100:00100000:2.0:1788582111.779245:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 161 00000100:00100000:2.0:1788582111.779256:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+44:11460:x1875464002018688:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:2.0:1788582111.779300:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582111.779320:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a76ba lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9347 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582111.779419:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a76c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582111.779433:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a76a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9339 expref: 45 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582111.779442:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a76c1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582111.779477:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a76a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9339 expref: 45 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582111.779490:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a76a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9339 expref: 45 pid: 10137 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582111.779505:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbfb06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875464020891136:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582111.779589:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d83da1900 going to sleep for 11 seconds 00000100:00100000:2.0:1788582111.783455:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582111.783549:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002018816 00000100:00100000:3.0:1788582111.783560:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002018816 00010000:00010000:3.0:1788582111.783614:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a76a5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9339 expref: 46 pid: 10137 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582111.783656:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 69 00000100:00100000:3.0:1788582111.783677:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaef9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99087a3-3c83-4416-b2b9-d522b9885111+46:2350:x1875464002018816:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582111.783696:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582111.783713:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a76a5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9339 expref: 46 pid: 10137 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.783729:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a76a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9339 expref: 46 pid: 10137 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.783758:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:3.0:1788582111.783764:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a76c1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.783776:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a76c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.783784:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a76c1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.783807:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582111.783874:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaef9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99087a3-3c83-4416-b2b9-d522b9885111+46:2350:x1875464002018816:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 199us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582111.783883:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 69 00010000:00010000:0.0:1788582111.784717:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a76a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9339 expref: 45 pid: 10137 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582111.784739:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbfb06d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875464020891136:192.168.201.12@tcp:104: 00010000:00010000:0.0:1788582111.784767:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a76c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.784777:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a76c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.784784:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a76c1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582111.784811:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1788582111.785010:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a76ba lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9347 expref: 46 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.785042:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a76c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9347 expref: 45 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582111.785060:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:0.0:1788582111.785063:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788582111.785066:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05e00, rc 0) 00000100:00100000:0.0:1788582111.785339:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+45:11460:x1875464002018688:12345-192.168.201.12@tcp:101:bash.0 Request processed in 6083us (6370us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1788582111.785349:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 161 00000100:00100000:2.0:1788582111.787983:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582111.788237:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002019072 00000100:00100000:3.0:1788582111.788249:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002019072 00000100:00100000:3.0:1788582111.788312:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 162 00000100:00100000:3.0:1788582111.788342:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+45:11460:x1875464002019072:12345-192.168.201.12@tcp:36:bash.0 00010000:00010000:3.0:1788582111.788612:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76cf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.788630:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.788642:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788582111.788868:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1788582111.788893:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003637f9b4 reply state 00000000797b31d1 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582111.788902:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788582111.789059:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaef8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+48:11460:x1875464002019072:12345-192.168.201.12@tcp:36:bash.0 Request processed in 707us (1073us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788582111.789066:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 162 00000020:00080000:3.0:1788582111.789072:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788582111.800719:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582111.801360:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002019200 00000100:00100000:1.0:1788582111.801373:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002019200 00000100:00100000:1.0:1788582111.801437:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 163 00000100:00100000:1.0:1788582111.801448:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+48:11460:x1875464002019200:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:1.0:1788582111.801479:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582111.801503:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a76d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c934e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582111.801593:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a76dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582111.801611:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a76c1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9347 expref: 49 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582111.801641:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76cf lrc: 2/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582111.801648:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a76dd lrc: 5/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582111.801683:0:5844:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582111.801726:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a76c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9347 expref: 49 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582111.801741:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a76c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9347 expref: 49 pid: 5845 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582111.801757:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90c16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875464020891264:192.168.201.12@tcp:104: 00000100:00100000:1.0:1788582111.801872:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c3300 going to sleep for 11 seconds 00010000:00010000:3.0:1788582111.802532:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76cf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.802544:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76cf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.802551:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.802557:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582111.802561:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76cf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.802584:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76cf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.802598:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:3.0:1788582111.802601:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582111.802605:0:3293:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a76dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.802614:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76cf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.802621:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76cf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582111.803940:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90c16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875464020891264:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582111.803968:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a76dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582111.804968:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582111.805143:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002019328 00000100:00100000:3.0:1788582111.805153:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002019328 00010000:00010000:3.0:1788582111.805197:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a76c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9347 expref: 49 pid: 5845 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582111.805267:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 70 00000100:00100000:3.0:1788582111.805278:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+49:2350:x1875464002019328:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582111.805294:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582111.805302:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a76c1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9347 expref: 49 pid: 5845 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.805313:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a76c1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9347 expref: 49 pid: 5845 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.805336:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a76c1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9347 expref: 49 pid: 5845 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.805365:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:3.0:1788582111.805370:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a76dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.805378:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a76dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.805385:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a76dd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.805413:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582111.805458:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+48:2350:x1875464002019328:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 183us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582111.805465:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 70 00010000:00010000:1.0:1788582111.805563:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a76dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582111.805571:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a76dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582111.805619:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788582111.805623:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788582111.805648:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a76dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582111.805684:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a76d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c934e expref: 48 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582111.805718:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a76dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c934e expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582111.805726:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:1.0:1788582111.805728:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788582111.805731:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fd200, rc 0) 00000100:00100000:1.0:1788582111.805759:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+47:11460:x1875464002019200:12345-192.168.201.12@tcp:101:bash.0 Request processed in 4314us (5063us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582111.805767:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 163 00000100:00100000:0.0:1788582111.808178:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582111.808284:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002019584 00000100:00100000:2.0:1788582111.808311:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002019584 00000100:00100000:2.0:1788582111.808377:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 45 00000100:00100000:2.0:1788582111.808389:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+47:11460:x1875464002019584:12345-192.168.201.12@tcp:35:bash.0 00000100:00100000:2.0:1788582111.817683:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+48:11460:x1875464002019584:12345-192.168.201.12@tcp:35:bash.0 Request processed in 2022us (2238us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1788582111.817719:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 45 00000100:00100000:0.0:1788582111.952405:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582111.952548:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002019840 00000100:00100000:2.0:1788582111.952559:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002019840 00000100:00100000:2.0:1788582111.952630:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 164 00000100:00100000:2.0:1788582111.952643:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+48:11470:x1875464002019840:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:2.0:1788582111.952674:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582111.952711:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a76e4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9355 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582111.952845:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788582111.953001:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a76e4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9355 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582111.953019:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d917bd600) 00010000:00010000:2.0:1788582111.953023:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788582111.953030:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a76e4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9355 expref: 50 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582111.953056:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05000, rc 0) 00000100:00100000:2.0:1788582111.953383:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+49:11470:x1875464002019840:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 740us (987us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1788582111.953392:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 164 00000100:00100000:0.0:1788582111.957510:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582111.957624:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002019968 00000100:00100000:3.0:1788582111.957637:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002019968 00000100:00100000:3.0:1788582111.957719:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 165 00000100:00100000:3.0:1788582111.957732:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+49:11470:x1875464002019968:12345-192.168.201.12@tcp:34:lfs.0 00010000:00010000:3.0:1788582111.957838:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76f2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.957858:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.957872:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.957889:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a76f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.957911:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a76f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.957918:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a76f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958198:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7700 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958252:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958260:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788582111.958304:0:10137:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958316:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76f2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958324:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958331:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958338:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582111.958343:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958351:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76f2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958372:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:3.0:1788582111.958375:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582111.958380:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958387:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a76f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958399:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a76f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958405:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a76f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958410:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a76f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958415:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582111.958417:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a76f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958422:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a76f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958428:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d0d917bdb00) 00010000:00010000:3.0:1788582111.958430:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582111.958433:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a76f9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958438:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a76f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958463:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7700 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958469:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7700 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958474:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7700 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958480:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582111.958483:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7700 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958489:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7700 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958497:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:3.0:1788582111.958500:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582111.958503:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7700 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582111.958508:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7700 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582111.958581:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+49:11470:x1875464002019968:12345-192.168.201.12@tcp:34:lfs.0 Request processed in 852us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582111.958591:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 165 00000100:00100000:0.0:1788582111.962515:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582111.962602:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002020224 00000100:00100000:3.0:1788582111.962623:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002020224 00000100:00100000:3.0:1788582111.962691:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 46 00000100:00100000:3.0:1788582111.962726:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+49:11470:x1875464002020224:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:3.0:1788582111.963023:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+50:11470:x1875464002020224:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 298us (518us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788582111.963031:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 46 00010000:00010000:3.0:1788582111.981431:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582112.001304:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582112.001401:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002020480 00000100:00100000:1.0:1788582112.001414:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002020480 00000100:00100000:1.0:1788582112.001483:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 166 00000100:00100000:1.0:1788582112.001495:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+50:11473:x1875464002020480:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:1.0:1788582112.001522:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582112.001544:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7707 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c935c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.001633:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a770e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.001649:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a770e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.001662:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a770e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.001677:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7715 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.001697:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.001717:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.001979:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a771c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.001989:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a771c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.001996:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a771c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582112.002007:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788582112.003315:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a770e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.003328:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a770e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.003336:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a770e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.003341:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd600 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582112.003346:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a770e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.003353:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a770e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.003385:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:1.0:1788582112.003388:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582112.003392:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a770e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.003399:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a770e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.003414:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7715 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.003421:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7715 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.003427:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.003432:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582112.003435:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7715 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.003441:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7715 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.003448:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d0da2faf400) 00010000:00010000:1.0:1788582112.003450:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582112.003453:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7715 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.003460:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7715 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.003522:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7707 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c935c expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.003536:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a771c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c935c expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.003543:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:1.0:1788582112.003546:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788582112.003548:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fde00, rc 0) 00000100:00100000:1.0:1788582112.003629:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+52:11473:x1875464002020480:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 2135us (2337us total) trans 4294967453 rc 0/0 00000100:00100000:1.0:1788582112.003638:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 166 00000100:00100000:0.0:1788582112.011509:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582112.011554:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582112.011640:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002020608 00000100:00100000:2.0:1788582112.011652:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002020608 00000100:00100000:2.0:1788582112.011726:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 167 00000100:00100000:2.0:1788582112.011737:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+52:11473:x1875464002020608:12345-192.168.201.12@tcp:54:lfs.0 00010000:00010000:2.0:1788582112.011818:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a772a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.011837:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a772a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.011857:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a772a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.011883:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a772a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.011890:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a772a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.011898:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a772a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.011904:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582112.011909:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a772a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.011917:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a772a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.011930:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:2.0:1788582112.011933:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788582112.011937:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a772a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.011960:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a772a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582112.012047:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+52:11473:x1875464002020608:12345-192.168.201.12@tcp:54:lfs.0 Request processed in 312us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582112.012056:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 167 00000100:00100000:3.0:1788582112.012573:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002020736 00000100:00100000:3.0:1788582112.012581:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002020736 00000100:00100000:3.0:1788582112.012630:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 11 00000100:00100000:3.0:1788582112.012639:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99087a3-3c83-4416-b2b9-d522b9885111+52:2349:x1875464002020736:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582112.012657:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582112.012674:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a771c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c935c expref: 52 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.012688:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:3.0:1788582112.012692:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582112.012742:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb68380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99087a3-3c83-4416-b2b9-d522b9885111+51:2349:x1875464002020736:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 103us (1186us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582112.012749:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 11 00000100:00100000:3.0:1788582112.013902:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582112.014140:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002020992 00000100:00100000:2.0:1788582112.014148:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002020992 00000100:00100000:2.0:1788582112.014382:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 47 00000100:00100000:2.0:1788582112.014393:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+51:11473:x1875464002020992:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:2.0:1788582112.014622:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc09f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+52:11473:x1875464002020992:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 230us (724us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1788582112.014630:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 47 00000100:00100000:1.0:1788582112.206006:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582112.208031:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002021248 00000100:00100000:2.0:1788582112.208047:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002021248 00000100:00100000:2.0:1788582112.208189:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 168 00000100:00100000:2.0:1788582112.208219:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+52:11491:x1875464002021248:12345-192.168.201.12@tcp:101:cat.0 00010000:00010000:2.0:1788582112.208245:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582112.208269:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7731 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9363 expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.208380:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7738 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.208396:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7738 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.208426:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7738 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582112.208439:0:10136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788582112.208568:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7731 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9363 expref: 55 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.208586:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7738 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9363 expref: 54 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.208594:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:2.0:1788582112.208597:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788582112.208601:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05800, rc 0) 00000100:00100000:2.0:1788582112.208695:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+54:11491:x1875464002021248:12345-192.168.201.12@tcp:101:cat.0 Request processed in 495us (2761us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788582112.208713:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 168 00000100:00100000:1.0:1788582112.270527:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582112.270645:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002021376 00000100:00100000:2.0:1788582112.270656:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002021376 00000100:00100000:2.0:1788582112.270766:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 169 00000100:00100000:2.0:1788582112.270778:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+54:11492:x1875464002021376:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:2.0:1788582112.270804:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582112.270827:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7746 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c936a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.270945:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a774d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.270974:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a774d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.270987:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a774d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582112.271030:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788582112.271034:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788582112.271055:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a774d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.271082:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7746 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c936a expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.271118:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a774d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c936a expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.271128:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:2.0:1788582112.271131:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788582112.271135:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05e00, rc 0) 00000100:00100000:2.0:1788582112.271447:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+55:11492:x1875464002021376:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 490us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582112.271457:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 169 00000100:00100000:0.0:1788582112.287844:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582112.288031:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002021760 00000100:00100000:2.0:1788582112.288042:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002021760 00000100:00100000:2.0:1788582112.288121:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 48 00000100:00100000:2.0:1788582112.288132:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+55:11492:x1875464002021760:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:2.0:1788582112.288495:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+56:11492:x1875464002021760:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 364us (660us total) trans 4294967456 rc 0/0 00000100:00100000:2.0:1788582112.288520:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 48 00000100:00100000:1.0:1788582112.291312:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582112.291398:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002021888 00000100:00100000:3.0:1788582112.291409:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002021888 00000100:00100000:3.0:1788582112.291529:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 12 00000100:00100000:3.0:1788582112.291541:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da7247450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+56:11492:x1875464002021888:12345-192.168.201.12@tcp:103:lfs.0 00010000:00010000:3.0:1788582112.291558:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788582112.291584:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a76dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c934e expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.291628:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7738 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9363 expref: 55 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.291641:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a75e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c930f expref: 54 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.291652:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:3.0:1788582112.291662:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582112.291742:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da7247450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+53:11492:x1875464002021888:12345-192.168.201.12@tcp:103:lfs.0 Request processed in 204us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582112.291751:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 12 00000100:00100000:2.0:1788582112.297587:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582112.297787:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002022016 00000100:00100000:3.0:1788582112.297807:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002022016 00000100:00100000:3.0:1788582112.297872:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 170 00000100:00100000:3.0:1788582112.297883:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+53:11492:x1875464002022016:12345-192.168.201.12@tcp:58:lfs.0 00010000:00010000:3.0:1788582112.298425:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7754 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.298445:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7754 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.298457:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7754 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788582112.298672:0:10137:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788582112.299122:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaef8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+53:11492:x1875464002022016:12345-192.168.201.12@tcp:58:lfs.0 Request processed in 1229us (1533us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582112.299143:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 170 00000100:00100000:0.0:1788582112.355138:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582112.355247:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002022144 00000100:00100000:2.0:1788582112.355259:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002022144 00000100:00100000:2.0:1788582112.355355:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 171 00000100:00100000:2.0:1788582112.355366:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+53:11494:x1875464002022144:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:2.0:1788582112.355391:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582112.355413:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a775b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9371 expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.355478:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7762 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.355493:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7762 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.355504:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7762 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.355519:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7769 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.355526:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.355532:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.355802:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7770 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.355821:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.355829:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582112.355868:0:10136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788582112.355873:0:10136:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788582112.355893:0:10136:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.355906:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7770 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.355914:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7762 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.355922:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7762 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.355930:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7762 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.355936:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04e00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582112.355940:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7762 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.355949:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7762 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.355960:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:2.0:1788582112.355969:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582112.355975:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7762 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.355981:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7762 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.355995:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7769 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.356001:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7769 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.356008:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7769 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.356014:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04600 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582112.356017:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7769 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.356023:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7769 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.356030:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d0d85afcc00) 00010000:00010000:2.0:1788582112.356032:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582112.356035:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7769 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.356041:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7769 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.356075:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a775b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9371 expref: 55 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.356101:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7770 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9371 expref: 54 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.356108:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdb00) 00010000:00010000:2.0:1788582112.356110:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788582112.356113:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04a00, rc 0) 00000100:00100000:2.0:1788582112.356184:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+54:11494:x1875464002022144:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 819us (1057us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582112.356192:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 171 00000040:00080000:1.0:1788582112.691983:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788582112.691992:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788582112.692385:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788582112.692393:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788582112.692515:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90c15c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875464020891392:192.168.201.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788582112.692618:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c3b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788582112.705029:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90c15c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875464020891392:192.168.201.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788582112.706438:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582112.706896:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002022272 00000100:00100000:2.0:1788582112.706909:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002022272 00000100:00100000:2.0:1788582112.706975:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 172 00000100:00100000:2.0:1788582112.706987:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+54:11505:x1875464002022272:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788582112.707029:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788582112.707411:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+54:11505:x1875464002022272:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 Request processed in 424us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582112.707420:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 172 00000100:00100000:0.0:1788582112.710935:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582112.711277:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002022400 00000100:00100000:3.0:1788582112.711288:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002022400 00000100:00100000:3.0:1788582112.711351:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 173 00000100:00100000:3.0:1788582112.711363:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+54:11505:x1875464002022400:12345-192.168.201.12@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788582112.711442:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7777 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711460:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7777 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711471:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7777 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711487:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a777e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711494:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a777e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711500:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a777e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711529:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7785 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711537:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711544:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582112.711597:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1788582112.711601:0:10137:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788582112.711614:0:10137:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711626:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7777 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711632:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7777 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711640:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7777 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711646:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582112.711651:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7777 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711672:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7777 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711686:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d0d888de500) 00010000:00010000:3.0:1788582112.711699:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582112.711703:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7777 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711710:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7777 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711722:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a777e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711738:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a777e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711745:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a777e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711750:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582112.711754:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a777e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711761:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a777e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711769:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff8d0d917bdc00) 00010000:00010000:3.0:1788582112.711772:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582112.711775:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a777e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711781:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a777e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711795:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7785 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711801:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7785 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711807:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7785 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711812:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582112.711819:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7785 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711825:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7785 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711833:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdb00) 00010000:00010000:3.0:1788582112.711835:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582112.711839:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7785 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.711845:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7785 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582112.711992:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+54:11505:x1875464002022400:12345-192.168.201.12@tcp:34:lhsmtool_posix.0 Request processed in 630us (1067us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582112.712002:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 173 00000100:00100000:3.0:1788582112.724132:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582112.724343:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002022656 00000100:00100000:2.0:1788582112.724354:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002022656 00000100:00100000:2.0:1788582112.724411:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 174 00000100:00100000:2.0:1788582112.724422:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+54:11505:x1875464002022656:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788582112.724444:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582112.724464:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a778c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9378 expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.724595:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7793 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.724613:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.724626:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582112.724639:0:10136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788582112.724770:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7793 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.724779:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7793 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.724785:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7793 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.724792:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04600 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582112.724797:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7793 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.724804:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7793 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.724817:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdb00) 00010000:00010000:2.0:1788582112.724820:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788582112.724825:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7793 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.724842:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7793 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.724886:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a778c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9378 expref: 56 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.724897:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d0d888de500) 00010000:00010000:2.0:1788582112.724899:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788582112.724903:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a778c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9378 expref: 56 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.724912:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05000, rc 0) 00000100:00100000:2.0:1788582112.724975:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+55:11505:x1875464002022656:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 554us (853us total) trans 4294967457 rc 301/301 00000100:00100000:2.0:1788582112.724983:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 174 00000100:00100000:1.0:1788582112.728623:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582112.729143:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002022784 00000100:00100000:2.0:1788582112.729155:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002022784 00000100:00100000:2.0:1788582112.729243:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 175 00000100:00100000:2.0:1788582112.729254:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+55:11505:x1875464002022784:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788582112.729489:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788582112.729656:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+55:11505:x1875464002022784:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 Request processed in 402us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582112.729672:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 175 00000100:00100000:1.0:1788582112.744062:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582112.744386:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002023040 00000100:00100000:3.0:1788582112.744397:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002023040 00000100:00100000:3.0:1788582112.744473:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 176 00000100:00100000:3.0:1788582112.744484:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+55:11505:x1875464002023040:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788582112.744507:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582112.744510:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788582112.744537:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a774d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c936a expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.744555:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:3.0:1788582112.744559:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788582112.744580:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a77a1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c937f expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788582112.745591:0:5845:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1788582112.745827:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a77a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.745842:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a77a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.745854:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a77a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.745909:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a77a1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c937f expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.745925:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a77a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c937f expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.745934:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:3.0:1788582112.745937:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788582112.745940:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26800, rc 0) 00000100:00100000:3.0:1788582112.746875:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+56:11505:x1875464002023040:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 2385us (2817us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788582112.746887:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 176 00000100:00100000:3.0:1788582112.749799:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582112.750655:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002023296 00000100:00100000:0.0:1788582112.750668:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002023296 00000100:00100000:0.0:1788582112.750732:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 177 00000100:00100000:0.0:1788582112.750742:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+56:11505:x1875464002023296:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788582112.750822:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582112.751150:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a77a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c937f expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.751169:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d0d917bdc00) 00010000:00010000:0.0:1788582112.751179:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788582112.751220:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a77b6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.751493:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a77b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.751506:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a77b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.751522:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a77bd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xe337394c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.751529:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a77bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe337394c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.751535:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a77bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe337394c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.751739:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a77b6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.751748:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a77b6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.751755:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a77b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.751766:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582112.751771:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a77b6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.751778:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a77b6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.751787:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:0.0:1788582112.751789:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582112.751793:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a77b6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.751799:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a77b6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.751808:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a77bd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xe337394c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.751815:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a77bd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe337394c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.751821:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a77bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe337394c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.751825:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088600 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582112.751828:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a77bd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe337394c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.752521:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a77bd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xe337394c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.752544:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xe337394c (ffff8d0d888dee00) 00010000:00010000:0.0:1788582112.752547:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582112.752551:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a77bd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe337394c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.752557:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a77bd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xe337394c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582112.752672:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+55:11505:x1875464002023296:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 Request processed in 1928us (2883us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788582112.752682:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 177 00000100:00100000:0.0:1788582112.758360:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582112.758734:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002023424 00000100:00100000:3.0:1788582112.758745:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002023424 00000100:00100000:3.0:1788582112.758803:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 178 00000100:00100000:3.0:1788582112.758815:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+55:11505:x1875464002023424:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788582112.758843:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582112.758868:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a77c4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9386 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.758911:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a77cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.758931:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a77cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.758945:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a77cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.759071:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a77c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9386 expref: 57 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.759290:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a77cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9386 expref: 56 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.759299:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d0d917bdf00) 00010000:00010000:3.0:1788582112.759301:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788582112.759305:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26000, rc 0) 00000100:00100000:3.0:1788582112.759366:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+56:11505:x1875464002023424:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 554us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582112.759374:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 178 00000100:00100000:3.0:1788582112.768974:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582112.769162:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002023680 00000100:00100000:0.0:1788582112.769192:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002023680 00000100:00100000:0.0:1788582112.769290:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 179 00000100:00100000:0.0:1788582112.769302:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+56:11505:x1875464002023680:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788582112.769417:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a77d2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.769447:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a77d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.769461:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a77d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788582112.769856:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:0.0:1788582112.769869:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 331763666239ns, next at 332763662732ns, rc = 0 00000004:00010000:0.0:1788582112.769959:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070f0c665 reply state 00000000ea29e0f8 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a77d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582112.769978:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788582112.770086:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+58:11505:x1875464002023680:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 Request processed in 785us (1120us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1788582112.770094:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 179 00010000:00010000:3.0:1788582112.772470:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a77d2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.772506:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a77d2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.772513:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a77d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.772519:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582112.772525:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a77d2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.772532:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a77d2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.772550:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d0d917bdf00) 00010000:00010000:3.0:1788582112.772553:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788582112.772558:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a77d2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.772563:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a77d2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582112.772614:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582112.772760:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002023808 00000100:00100000:3.0:1788582112.772770:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002023808 00000100:00100000:3.0:1788582112.772824:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 180 00000100:00100000:3.0:1788582112.772834:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbfb06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+57:11505:x1875464002023808:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788582112.772859:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582112.772875:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a77d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c938d expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.772932:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a77d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c938d expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.772953:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a77d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c938d expref: 58 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.772973:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d0d917bdf00) 00010000:00010000:3.0:1788582112.772976:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788582112.772979:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27400, rc 0) 00000100:00100000:3.0:1788582112.773150:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbfb06d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+58:11505:x1875464002023808:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 317us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582112.773158:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 180 00000100:00100000:3.0:1788582112.775378:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582112.775452:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002023936 00000100:00100000:1.0:1788582112.775471:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002023936 00000100:00100000:1.0:1788582112.775542:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 50 00000100:00100000:1.0:1788582112.775552:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+6:2351:x1875464002023936:12345-192.168.201.12@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788582112.775858:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+7:2351:x1875464002023936:12345-192.168.201.12@tcp:2:lhsmtool_posix.0 Request processed in 307us (486us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788582112.775867:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 50 00000100:00080000:2.0:1788582112.776820:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788582112.777700:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582112.777946:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002024192 00000100:00100000:0.0:1788582112.777955:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002024192 00000100:00100000:0.0:1788582112.777998:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 49 00000100:00100000:0.0:1788582112.778008:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+58:11505:x1875464002024192:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788582112.778367:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+59:11505:x1875464002024192:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 Request processed in 360us (683us total) trans 4294967460 rc 0/0 00000100:00100000:0.0:1788582112.778375:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 49 00000100:00100000:3.0:1788582112.779933:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582112.780761:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002024448 00000100:00100000:1.0:1788582112.780773:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002024448 00000100:00100000:1.0:1788582112.780835:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 181 00000100:00100000:1.0:1788582112.780847:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+59:11505:x1875464002024448:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788582112.780970:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+59:11505:x1875464002024448:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 Request processed in 125us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582112.780978:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 181 00000100:00100000:3.0:1788582112.785995:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582112.786067:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002024576 00000100:00100000:2.0:1788582112.786084:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002024576 00000100:00100000:2.0:1788582112.786181:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 182 00000100:00100000:2.0:1788582112.786193:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+59:11505:x1875464002024576:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788582112.786236:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582112.786260:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a77e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9394 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.786334:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a77e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.786349:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a77e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.786358:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a77e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582112.786390:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788582112.786405:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a77e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.786426:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a77e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9394 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.786443:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a77e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9394 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.786451:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d0d917bdf00) 00010000:00010000:2.0:1788582112.786453:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788582112.786457:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04e00, rc 0) 00000100:00100000:2.0:1788582112.786513:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+60:11505:x1875464002024576:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 323us (525us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582112.786529:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 182 00000100:00100000:1.0:1788582112.790543:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582112.791933:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002024704 00000100:00100000:3.0:1788582112.791948:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002024704 00000100:00100000:2.0:1788582112.792626:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 51 00000100:00100000:2.0:1788582112.792642:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+7:2349:x1875464002024704:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788582112.792665:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582112.792699:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a77ee lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c939b expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788582112.792728:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b98e0, blocks: 0x1 00010000:00010000:2.0:1788582112.792749:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=331s v=(0 0) 00010000:00010000:2.0:1788582112.792754:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788582112.792765:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a77ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c939b expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.792784:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a77ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c939b expref: 8 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.792797:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05200, rc 0) 00000100:00100000:2.0:1788582112.792865:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c17480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+8:2349:x1875464002024704:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 228us (2332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582112.792873:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 51 00000100:00100000:3.0:1788582112.794959:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582112.795040:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002024960 00000100:00100000:0.0:1788582112.795051:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002024960 00000100:00100000:0.0:1788582112.795114:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 183 00000100:00100000:0.0:1788582112.795124:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+60:11505:x1875464002024960:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788582112.795260:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+60:11505:x1875464002024960:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 Request processed in 137us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582112.795268:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 183 00000100:00100000:3.0:1788582112.797332:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582112.798158:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002025088 00000100:00100000:1.0:1788582112.798167:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002025088 00000100:00100000:1.0:1788582112.799170:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 52 00000100:00100000:1.0:1788582112.799185:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf2df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+8:11505:x1875464002025088:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788582112.799219:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582112.799240:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a77f5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c93a2 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.799282:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a77ee lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c939b expref: 9 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.799304:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582112.799309:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582112.799315:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a77f5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93a2 expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.799358:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a77ee lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c939b expref: 9 pid: 6692 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.799370:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a77ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c939b expref: 9 pid: 6692 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582112.799382:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90c14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1875464020891520:192.168.201.12@tcp:104: 00000100:00100000:1.0:1788582112.799498:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c39c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788582112.803494:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582112.803561:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002025216 00000100:00100000:2.0:1788582112.803570:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002025216 00010000:00010000:2.0:1788582112.803611:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a77ee lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c939b expref: 10 pid: 6692 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582112.803667:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 71 00000100:00100000:2.0:1788582112.803679:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99087a3-3c83-4416-b2b9-d522b9885111+10:2350:x1875464002025216:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788582112.803703:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582112.803728:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a77ee lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c939b expref: 10 pid: 6692 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.803743:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a77ee lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c939b expref: 10 pid: 6692 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.803771:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788582112.803776:0:5830:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788582112.803784:0:5830:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a77f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93a2 expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.803795:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a77f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93a2 expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.803832:0:5830:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a77f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93a2 expref: 10 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582112.803846:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaef9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5830:1875464020891648:192.168.201.12@tcp:105: 00000100:00100000:2.0:1788582112.803920:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d83da1cc0 going to sleep for 11 seconds 00010000:00010000:3.0:1788582112.804181:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000345c3844/0x2bc3aa892c3a77ee lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c939b expref: 10 pid: 6692 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582112.804195:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90c14380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1875464020891520:192.168.201.12@tcp:104: 00010000:00010000:3.0:1788582112.805922:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a77f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93a2 expref: 9 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.805944:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fd800, rc 0) 00000100:00100000:3.0:1788582112.806055:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf2df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+9:11505:x1875464002025088:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 6872us (8729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582112.806065:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 52 00000100:00100000:3.0:1788582112.807133:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaef9500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5830:1875464020891648:192.168.201.12@tcp:105: 00010000:00010000:3.0:1788582112.807150:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582112.807296:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d12a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99087a3-3c83-4416-b2b9-d522b9885111+8:2350:x1875464002025216:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 3618us (3808us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582112.807308:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 71 00000100:00100000:0.0:1788582112.810128:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582112.810747:0:12171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002025344 00000100:00100000:3.0:1788582112.810758:0:12171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002025344 00002000:00100000:3.0:1788582112.810820:0:12171:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8d0d90d10000 x1875464002025344/t0(0) o4->b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp:713/0 lens 504/0 e 0 to 0 dl 1788582123 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788582112.810833:0:12171:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0d90d10000 with x1875464002025344 ext(0->8) 00002000:00010000:3.0:1788582112.810839:0:12171:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0d90d10000 00000100:00100000:3.0:1788582112.810875:0:12171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 4 00000100:00100000:3.0:1788582112.810887:0:12171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b99087a3-3c83-4416-b2b9-d522b9885111+8:2349:x1875464002025344:12345-192.168.201.12@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788582112.811716:0:12171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d10000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b99087a3-3c83-4416-b2b9-d522b9885111+10:2349:x1875464002025344:12345-192.168.201.12@tcp:4:lhsmtool_posix.0 Request processed in 827us (1598us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788582112.811725:0:12171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 4 00002000:00100000:3.0:1788582112.811733:0:12171:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff8d0d90d10000 x1875464002025344/t4294967314(0) o4->b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp:713/0 lens 504/448 e 0 to 0 dl 1788582123 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788582112.811742:0:12171:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0d90d10000 with x1875464002025344 ext(0->8) 00002000:00010000:3.0:1788582112.811746:0:12171:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0d90d10000 00000100:00100000:2.0:1788582112.817865:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582112.817999:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002025472 00000100:00100000:3.0:1788582112.818032:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002025472 00000100:00100000:3.0:1788582112.818116:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 184 00000100:00100000:3.0:1788582112.818127:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+60:11505:x1875464002025472:12345-192.168.201.12@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1788582112.877907:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaef9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+60:11505:x1875464002025472:12345-192.168.201.12@tcp:44:lhsmtool_posix.0 Request processed in 59770us (60044us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582112.877921:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 184 00000001:00080000:3.0:1788582112.880935:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:3.0:1788582112.880956:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:3.0:1788582112.880991:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000100:00100000:1.0:1788582112.881195:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788582112.881242:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020891776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788582112.881315:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582112.881377:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020891776 00000100:00100000:1.0:1788582112.881384:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020891776 00000100:00100000:1.0:1788582112.881428:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788582112.881438:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020891776:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1788582112.881600:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788582112.881616:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788582112 00002000:00010000:1.0:1788582112.881619:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788582112.881621:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788582112 -> 1788582112 00002000:00010000:1.0:1788582112.881624:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788582112.881664:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875464020891776:12345-0@lo:2:osp-syn-1-0.0 Request processed in 227us (349us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1788582112.881672:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:1.0:1788582112.881744:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d0d90c16300/2, rc 0, transno 4294967315 00000100:00100000:1.0:1788582112.881751:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90c16300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020891776:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788582112.882063:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582112.885550:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c83087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020891904:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788582112.885631:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788582112.886844:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d0dbf75fe40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788582112.886854:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d0d9148f200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d0dbf75f3c0 00000020:00080000:3.0:1788582112.886857:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d0d9148f400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d0dbad0f400 00000100:00100000:3.0:1788582112.887005:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002025600 00000100:00100000:3.0:1788582112.887015:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002025600 00000100:00100000:3.0:1788582112.887191:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020891904 00000100:00100000:3.0:1788582112.887195:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020891904 00000100:00100000:3.0:1788582112.887241:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 54 00000100:00100000:3.0:1788582112.887251:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+10:2350:x1875464002025600:12345-192.168.201.12@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788582112.887319:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788582112.887327:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1875464020891904:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1788582112.887341:0:8034:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1788582112.887373:0:8034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a9b98dd, atime: 0x6a9b98dd, ctime: 0x6a9b98dd, blocks: 0x1 00010000:00010000:3.0:1788582112.887382:0:8034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0ef0e7d/0x2bc3aa892c3a77fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.887397:0:8034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=331s v=(0 0) 00010000:00010000:3.0:1788582112.887402:0:8034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582112.887407:0:8034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b0ef0e7d/0x2bc3aa892c3a77fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.887437:0:8034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b0ef0e7d/0x2bc3aa892c3a77fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.887447:0:8034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b0ef0e7d/0x2bc3aa892c3a77fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.887455:0:8034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b0ef0e7d/0x2bc3aa892c3a77fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.887472:0:8034:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:2.0:1788582112.890236:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788582112.890455:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788582112.890867:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3309:x1875464020891904:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3534us (5228us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788582112.890881:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:3.0:1788582112.890952:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788582112.890962:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b0ef0e7d/0x2bc3aa892c3a77fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.890976:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27800 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:3.0:1788582112.890981:0:7637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0ef0e7d/0x2bc3aa892c3a77fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.890993:0:7637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b0ef0e7d/0x2bc3aa892c3a77fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.891017:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b0ef0e7d/0x2bc3aa892c3a77fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.891189:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0ef0e7d/0x2bc3aa892c3a77fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.891235:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582112.891237:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582112.891239:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788582112.893718:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d0c83087480/2, rc 0, transno 4294967307 00000100:00100000:1.0:1788582112.893738:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c83087480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020891904:0@lo:6:osp-syn-0-0.0 00000001:00080000:2.0:1788582112.946614:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:2.0:1788582112.946631:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1788582112.946637:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:3.0:1788582112.946828:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+7:2350:x1875464002025600:12345-192.168.201.12@tcp:16:lhsmtool_posix.0 Request processed in 59572us (64760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582112.946840:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 54 00000100:00100000:2.0:1788582112.950442:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582112.950567:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002025856 00000100:00100000:0.0:1788582112.950578:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002025856 00000100:00100000:0.0:1788582112.950710:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 185 00000100:00100000:0.0:1788582112.950720:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+18:11505:x1875464002025856:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788582112.950793:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582112.950823:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a77e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9394 expref: 18 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.950845:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d0d917bdf00) 00010000:00010000:0.0:1788582112.950850:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788582112.950887:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7803 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.950903:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7803 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.950915:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7803 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788582112.951245:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000205098ef reply state 000000005465d2fd transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7803 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582112.951255:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788582112.951356:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83084380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+19:11505:x1875464002025856:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 Request processed in 637us (925us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788582112.951364:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 185 00000100:00100000:2.0:1788582112.955332:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582112.955424:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002025984 00000100:00100000:1.0:1788582112.955436:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002025984 00000100:00100000:1.0:1788582112.955499:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 56 00000100:00100000:1.0:1788582112.955511:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+7:2350:x1875464002025984:12345-192.168.201.12@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788582112.955825:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788582112.955829:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788582112 -> 1788582111 00002000:00010000:1.0:1788582112.955831:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788582109 00002000:00010000:1.0:1788582112.955834:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788582112 -> 1788582111 00002000:00010000:1.0:1788582112.955836:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788582112.955901:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83086300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+8:2350:x1875464002025984:12345-192.168.201.12@tcp:2:lhsmtool_posix.0 Request processed in 392us (578us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1788582112.955909:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 56 00010000:00010000:3.0:1788582112.958420:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7803 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.958437:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7803 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.958445:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7803 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.958450:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582112.958455:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7803 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.958462:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7803 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.958478:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d0d917bdf00) 00010000:00010000:3.0:1788582112.958481:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582112.958486:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7803 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.958508:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7803 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582112.958910:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582112.959027:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002026240 00000100:00100000:3.0:1788582112.959046:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002026240 00000100:00100000:3.0:1788582112.959107:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 186 00000100:00100000:3.0:1788582112.959117:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+18:11505:x1875464002026240:12345-192.168.201.12@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788582112.959189:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a780a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.959230:0:10137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a77cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9386 expref: 18 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.959240:0:10137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a780a lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.959275:0:10137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a77cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9386 expref: 18 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.959289:0:10137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a77cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9386 expref: 18 pid: 10137 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582112.959304:0:10137:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab900a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10137:1875464020892032:192.168.201.12@tcp:104: 00000100:00100000:3.0:1788582112.959397:0:10137:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8da240 going to sleep for 11 seconds 00000100:00100000:0.0:1788582112.962536:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582112.962654:0:10137:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab900a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10137:1875464020892032:192.168.201.12@tcp:104: 00010000:00010000:3.0:1788582112.962700:0:10137:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a780a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582112.962810:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002026368 00000100:00100000:2.0:1788582112.962819:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002026368 00010000:00010000:2.0:1788582112.962874:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a77cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9386 expref: 19 pid: 10137 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582112.962924:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 72 00000100:00100000:2.0:1788582112.962934:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+19:2350:x1875464002026368:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788582112.962953:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582112.962961:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a77cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9386 expref: 19 pid: 10137 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.962976:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a77cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9386 expref: 19 pid: 10137 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.963008:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a77cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9386 expref: 19 pid: 10137 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.963027:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d0d917bdf00) 00010000:00010000:2.0:1788582112.963032:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a780a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.963053:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a780a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.963070:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a780a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582112.963115:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582112.963192:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+18:2350:x1875464002026368:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 259us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582112.963230:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 72 00010000:00010000:1.0:1788582112.963306:0:10137:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a780a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.963314:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a780a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.963353:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a780a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.963360:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a780a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.963367:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a780a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.963374:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582112.963380:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a780a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.963387:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a780a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.963398:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d0d917bdf00) 00010000:00010000:1.0:1788582112.963401:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1788582112.963405:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a780a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.963411:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a780a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582112.963455:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+17:11505:x1875464002026240:12345-192.168.201.12@tcp:55:lhsmtool_posix.0 Request processed in 4340us (4550us total) trans 0 rc -22/-22 00000100:00100000:1.0:1788582112.963474:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 186 00000100:00100000:2.0:1788582112.966037:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582112.966572:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002026496 00000100:00100000:3.0:1788582112.966584:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002026496 00000100:00100000:3.0:1788582112.966709:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 57 00000100:00100000:3.0:1788582112.966721:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+8:2350:x1875464002026496:12345-192.168.201.12@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788582112.966773:0:8034:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7811 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.966797:0:8034:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a77f5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93a2 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.966806:0:8034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582112.966811:0:8034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788582112.966816:0:8034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7811 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.966861:0:8034:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a77f5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93a2 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.966877:0:8034:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a77f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93a2 expref: 8 pid: 6693 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582112.966895:0:8034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab900a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8034:1875464020892160:192.168.201.12@tcp:104: 00000100:00100000:3.0:1788582112.966993:0:8034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8da240 going to sleep for 11 seconds 00000100:00100000:1.0:1788582112.976008:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582112.976047:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002026624 00000100:00100000:1.0:1788582112.976058:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002026624 00010000:00010000:1.0:1788582112.976112:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a77f5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93a2 expref: 9 pid: 6693 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582112.976158:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 73 00000100:00100000:1.0:1788582112.976170:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+9:2349:x1875464002026624:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788582112.976186:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582112.976227:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a77f5 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93a2 expref: 9 pid: 6693 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.976242:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a77f5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93a2 expref: 9 pid: 6693 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.976269:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788582112.976275:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788582112.976281:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7811 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.976293:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7811 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.976314:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788582112.976371:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+9:2349:x1875464002026624:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 202us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582112.976387:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 73 00010000:00010000:0.0:1788582112.976624:0:8034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a77f5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93a2 expref: 8 pid: 6693 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582112.976641:0:8034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab900a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8034:1875464020892160:192.168.201.12@tcp:104: 00010000:00010000:0.0:1788582112.976663:0:8034:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7811 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.976680:0:8034:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7811 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.976698:0:8034:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7811 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.976723:0:8034:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7811 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.976732:0:8034:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7811 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.976740:0:8034:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7811 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.976748:0:8034:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26200 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:0.0:1788582112.976752:0:8034:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7811 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.976761:0:8034:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7811 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.976775:0:8034:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7811 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582112.976794:0:8034:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7811 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582112.976856:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83084a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+7:2350:x1875464002026496:12345-192.168.201.12@tcp:1:lhsmtool_posix.0 Request processed in 10138us (10839us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582112.976866:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 57 00000100:00100000:1.0:1788582112.991078:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582112.991247:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002026880 00000100:00100000:3.0:1788582112.991258:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002026880 00000100:00100000:3.0:1788582112.991329:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 187 00000100:00100000:3.0:1788582112.991340:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+17:11505:x1875464002026880:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788582112.991430:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7818 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.991449:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7818 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.991460:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7818 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.991701:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a781f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.991714:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a77d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c938d expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.991722:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a781f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.991763:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a77d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c938d expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.991778:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a77d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c938d expref: 18 pid: 5844 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582112.991797:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab901880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875464020892288:192.168.201.12@tcp:104: 00000100:00100000:3.0:1788582112.991883:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8da600 going to sleep for 11 seconds 00000100:00100000:1.0:1788582112.994645:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582112.994697:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002027008 00000100:00100000:1.0:1788582112.994707:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002027008 00010000:00010000:1.0:1788582112.994747:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a77d9 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c938d expref: 19 pid: 5844 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582112.994784:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 74 00000100:00100000:1.0:1788582112.994795:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+19:2350:x1875464002027008:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788582112.994816:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582112.994824:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a77d9 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c938d expref: 19 pid: 5844 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.994837:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a77d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c938d expref: 19 pid: 5844 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.994860:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d0d917bdf00) 00010000:00010000:1.0:1788582112.994865:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a781f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.994873:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a781f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.994881:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a781f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582112.994900:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788582112.994960:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+19:2350:x1875464002027008:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 166us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582112.994968:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 74 00010000:00010000:3.0:1788582112.995257:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a77d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c938d expref: 18 pid: 5844 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582112.995284:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab901880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875464020892288:192.168.201.12@tcp:104: 00010000:00010000:3.0:1788582112.995307:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a781f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.995316:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a781f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582112.995322:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a781f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788582112.995520:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1788582112.995678:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1788582112.995730:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1788582112.995813:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab901880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1875464020892416:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788582112.995871:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582112.995904:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85325900 going to sleep for 11 seconds 00000100:00100000:1.0:1788582112.996257:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020892416 00000100:00100000:1.0:1788582112.996264:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020892416 00000100:00100000:1.0:1788582112.996312:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788582112.996320:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875464020892416:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788582112.996395:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab903b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875464020892416:12345-0@lo:1000:mdt00_002.0 Request processed in 75us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582112.996405:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788582112.998334:0:5845:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1788582112.998345:0:5845:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d0d90c16300, transno 4294967315 00000100:00100000:3.0:1788582112.998363:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab901880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1875464020892416:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1788582112.998929:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1788582112.999022:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dab901880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1875464020892544:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788582113.000604:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582113.000673:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d84cfd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788582113.000819:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020892544 00000100:00100000:1.0:1788582113.000829:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020892544 00000100:00100000:1.0:1788582113.000893:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788582113.000904:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5845:x1875464020892544:12345-0@lo:1000:mdt00_002.0 00000100:00080000:3.0:1788582113.001154:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788582113.001358:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab900a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5845:x1875464020892544:12345-0@lo:1000:mdt00_002.0 Request processed in 455us (761us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1788582113.001367:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788582113.001451:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dab901880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5845:1875464020892544:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788582113.001492:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a781f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.001514:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a781f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.001522:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a781f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.001529:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582113.001533:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a781f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.001540:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a781f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.001557:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d0d917bdf00) 00010000:00010000:3.0:1788582113.001560:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788582113.001564:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a781f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.001571:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a781f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.001602:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7754 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.001609:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7754 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.001614:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7754 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.001620:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582113.001628:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7754 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.001634:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7754 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.001642:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdb00) 00010000:00010000:3.0:1788582113.001644:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788582113.001648:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7754 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.001654:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7754 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.001677:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7826 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.001704:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7770 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9371 expref: 21 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.001713:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7826 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.001746:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7770 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9371 expref: 21 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.001761:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7770 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9371 expref: 21 pid: 10136 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582113.001775:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbad3c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875464020892672:192.168.201.12@tcp:104: 00000100:00100000:3.0:1788582113.001850:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d84cfd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788582113.005714:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582113.005838:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002027136 00000100:00100000:0.0:1788582113.005850:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002027136 00010000:00010000:0.0:1788582113.005914:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7770 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9371 expref: 22 pid: 10136 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582113.005954:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 75 00000100:00100000:0.0:1788582113.005967:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+22:2349:x1875464002027136:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788582113.005988:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582113.005996:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7770 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9371 expref: 22 pid: 10136 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.006011:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7770 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9371 expref: 22 pid: 10136 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.006035:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdb00) 00010000:00010000:0.0:1788582113.006041:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7826 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.006051:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7826 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788582113.006156:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788582113.006438:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582113.006484:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7826 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.006510:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788582113.006574:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+22:2349:x1875464002027136:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 610us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582113.006582:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 75 00010000:00010000:3.0:1788582113.007164:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7770 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9371 expref: 21 pid: 10136 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582113.007179:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbad3c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5845:1875464020892672:192.168.201.12@tcp:104: 00010000:00010000:3.0:1788582113.007225:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7826 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.007236:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7826 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.007242:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7826 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.007254:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7826 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.007260:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7826 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.007266:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7826 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.007272:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582113.007277:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7826 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.007284:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7826 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.007296:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdb00) 00010000:00010000:3.0:1788582113.007299:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582113.007310:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7826 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.007316:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7826 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.007328:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7818 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.007333:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7818 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.007339:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7818 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.007344:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582113.007348:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7818 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.007354:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7818 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.007361:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdb00) 00010000:00010000:3.0:1788582113.007364:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788582113.007366:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7818 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.007372:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7818 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582113.007593:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+20:11505:x1875464002026880:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 Request processed in 16254us (16532us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1788582113.007603:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 187 00000020:00080000:3.0:1788582113.007613:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788582113.010910:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788582113.010922:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788582113.011538:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1788582113.011548:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788582113.013854:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582113.023249:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002027392 00000100:00100000:0.0:1788582113.023270:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002027392 00000100:00100000:0.0:1788582113.023353:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 50 00000100:00100000:0.0:1788582113.023367:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d84ecf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+20:11505:x1875464002027392:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788582113.028232:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788582113.028507:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1788582113.028586:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a782d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.028605:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a782d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.028618:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a782d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.028626:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a782d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.028642:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a782d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.028649:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a782d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.028681:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788582113.028808:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d84ecf850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+22:11505:x1875464002027392:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 Request processed in 5439us (14963us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1788582113.028818:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 50 00000020:00080000:0.0:1788582113.028824:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788582113.031847:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788582113.031864:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a782d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.031876:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089800 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:3.0:1788582113.031880:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a782d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.031891:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a782d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.031913:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff8d0d888def00) 00010000:00010000:3.0:1788582113.031916:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788582113.031921:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a782d lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.031927:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a782d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.031948:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582113.031950:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582113.031952:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788582113.190663:0:12511:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788582113.190673:0:12511:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788582113.190722:0:12511:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1788582113.190727:0:12511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788582113.262790:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788582113.262826:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c83085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020892800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788582113.262923:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582113.263148:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020892800 00000100:00100000:2.0:1788582113.263160:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020892800 00000100:00100000:2.0:1788582113.263263:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788582113.263273:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875464020892800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788582113.263315:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788582113.263363:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc09f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875464020892800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582113.263370:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1788582113.263441:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788582113.263588:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c83085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020892800:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788582113.366367:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582113.366938:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002027648 00000100:00100000:2.0:1788582113.366951:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002027648 00000100:00100000:2.0:1788582113.367027:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 188 00000100:00100000:2.0:1788582113.367039:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+22:11515:x1875464002027648:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:2.0:1788582113.367065:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582113.367089:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7834 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c93a9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.367233:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a783b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.367271:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a783b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.367285:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a783b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582113.367298:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788582113.367452:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7834 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93a9 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.367472:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a783b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93a9 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.367480:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:2.0:1788582113.367483:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788582113.367487:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05400, rc 0) 00000100:00100000:2.0:1788582113.367559:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+24:11515:x1875464002027648:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 522us (1201us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1788582113.367567:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 188 00000100:00100000:3.0:1788582113.373936:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582113.374019:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002027776 00000100:00100000:0.0:1788582113.374030:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002027776 00000100:00100000:0.0:1788582113.374094:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 189 00000100:00100000:0.0:1788582113.374104:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+24:11515:x1875464002027776:12345-192.168.201.12@tcp:34:lfs.0 00010000:00010000:0.0:1788582113.374190:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7849 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.374221:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7849 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.374232:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7849 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.374260:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7850 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.374267:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.374273:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.374527:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7857 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.374537:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.374544:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788582113.374587:0:10137:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.374599:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7849 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.374605:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7849 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.374612:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7849 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.374618:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089e00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582113.374622:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7849 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.374933:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7849 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.374945:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:0.0:1788582113.374948:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582113.374952:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7849 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.374957:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7849 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.374968:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.374973:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7850 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.374979:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7850 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.374984:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582113.374987:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7850 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.374993:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7850 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.374999:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d0d888de400) 00010000:00010000:0.0:1788582113.375001:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582113.375004:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7850 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.375020:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7850 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.375035:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7857 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.375041:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7857 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.375047:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7857 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.375052:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582113.375055:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7857 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.375060:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7857 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.375066:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d888def00) 00010000:00010000:0.0:1788582113.375068:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582113.375071:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7857 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.375077:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7857 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582113.375286:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+24:11515:x1875464002027776:12345-192.168.201.12@tcp:34:lfs.0 Request processed in 1181us (1359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582113.375295:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 189 00000100:00100000:1.0:1788582113.438010:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582113.439537:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002028032 00000100:00100000:3.0:1788582113.439553:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002028032 00000100:00100000:3.0:1788582113.439631:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 190 00000100:00100000:3.0:1788582113.439643:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+24:11518:x1875464002028032:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:3.0:1788582113.439669:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582113.439712:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a785e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c93b0 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.439814:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7865 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.439830:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7865 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.439842:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7865 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.439859:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a786c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.439866:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a786c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.439873:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a786c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.440181:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7873 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.440190:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.440198:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582113.441635:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788582113.441798:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7865 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.441825:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7865 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.442471:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7865 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.442480:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582113.442485:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7865 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.442493:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7865 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.442512:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:3.0:1788582113.442516:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582113.442521:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7865 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.442528:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7865 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.442544:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a786c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.442550:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a786c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.442555:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a786c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.442561:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582113.442573:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a786c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.442579:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a786c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.442588:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d0d917bdb00) 00010000:00010000:3.0:1788582113.442590:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582113.442593:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a786c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.442599:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a786c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.442654:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a785e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93b0 expref: 27 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.442669:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7873 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93b0 expref: 26 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.442685:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdf00) 00010000:00010000:3.0:1788582113.442688:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788582113.442690:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27800, rc 0) 00000100:00100000:3.0:1788582113.444757:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+26:11518:x1875464002028032:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 5098us (6742us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1788582113.444773:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 190 00000100:00100000:2.0:1788582113.458606:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582113.458760:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002028160 00000100:00100000:3.0:1788582113.458773:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002028160 00000100:00100000:3.0:1788582113.458848:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 191 00000100:00100000:3.0:1788582113.458860:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+26:11518:x1875464002028160:12345-192.168.201.12@tcp:54:lfs.0 00010000:00010000:3.0:1788582113.458963:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7881 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.458981:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.458993:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.459036:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.459044:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7881 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.459050:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7881 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.459056:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582113.459061:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7881 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.459070:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7881 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.459083:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdf00) 00010000:00010000:3.0:1788582113.459086:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788582113.459091:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7881 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.459097:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7881 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582113.459195:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83087b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+26:11518:x1875464002028160:12345-192.168.201.12@tcp:54:lfs.0 Request processed in 337us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582113.459235:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 191 00000100:00100000:2.0:1788582113.465302:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582113.465589:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002028416 00000100:00100000:1.0:1788582113.465604:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002028416 00000100:00100000:1.0:1788582113.465668:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 51 00000100:00100000:1.0:1788582113.465691:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+26:11518:x1875464002028416:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:1.0:1788582113.468222:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+27:11518:x1875464002028416:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 2514us (2909us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788582113.468519:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 51 00000100:00100000:3.0:1788582113.529798:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582113.530263:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002028672 00000100:00100000:1.0:1788582113.530275:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002028672 00000100:00100000:1.0:1788582113.530456:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 192 00000100:00100000:1.0:1788582113.530468:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+27:11052:x1875464002028672:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:1.0:1788582113.530492:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582113.530515:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7888 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c93b7 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.530611:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a788f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.530622:0:10137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7873 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93b0 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.530628:0:10137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a788f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.530685:0:10137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7873 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93b0 expref: 28 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.530699:0:10137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7873 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93b0 expref: 28 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582113.530713:0:10137:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10137:1875464020892928:192.168.201.12@tcp:104: 00000100:00100000:1.0:1788582113.530820:0:10137:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dab9c2600 going to sleep for 11 seconds 00000100:00100000:3.0:1788582113.534227:0:10137:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc2300 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10137:1875464020892928:192.168.201.12@tcp:104: 00010000:00010000:3.0:1788582113.534257:0:10137:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a788f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582113.539829:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582113.540257:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002028800 00000100:00100000:1.0:1788582113.540268:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002028800 00010000:00010000:1.0:1788582113.540595:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7873 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93b0 expref: 29 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582113.540634:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 76 00000100:00100000:1.0:1788582113.540644:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+29:2349:x1875464002028800:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788582113.540658:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582113.540666:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7873 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93b0 expref: 29 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.540689:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7873 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93b0 expref: 29 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.540713:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7873 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93b0 expref: 29 pid: 5845 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.540728:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdf00) 00010000:00010000:1.0:1788582113.540733:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a788f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.540742:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a788f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.540749:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a788f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.540781:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788582113.540821:0:10137:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a788f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.540829:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a788f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582113.540849:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00000100:00100000:1.0:1788582113.540855:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+28:2349:x1875464002028800:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 212us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582113.540863:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 76 00010000:00010000:3.0:1788582113.542050:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd800/0x2bc3aa892c3a7888 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93b7 expref: 29 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.542142:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a788f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93b7 expref: 28 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.542151:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdf00) 00010000:00010000:3.0:1788582113.542154:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788582113.542157:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fc200, rc 0) 00000100:00100000:3.0:1788582113.542233:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+28:11052:x1875464002028672:12345-192.168.201.12@tcp:101:bash.0 Request processed in 11766us (12446us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788582113.542252:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 192 00000100:00100000:1.0:1788582113.545498:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582113.547283:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002029056 00000100:00100000:2.0:1788582113.547300:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002029056 00000100:00100000:2.0:1788582113.547365:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 193 00000100:00100000:2.0:1788582113.547376:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+28:11052:x1875464002029056:12345-192.168.201.12@tcp:36:bash.0 00010000:00010000:2.0:1788582113.547634:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a789d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.547686:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a789d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.547701:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a789d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788582113.547755:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:2.0:1788582113.547780:0:5845:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e79f5b6e reply state 00000000e2287c5e transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a789d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582113.547790:0:5845:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788582113.547835:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1788582113.547952:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+32:11052:x1875464002029056:12345-192.168.201.12@tcp:36:bash.0 Request processed in 577us (2466us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1788582113.547961:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 193 00000020:00080000:2.0:1788582113.547967:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788582113.551650:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a789d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.551669:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a789d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.551691:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a789d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.551697:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04600 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582113.551702:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a789d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.551709:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a789d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.551731:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdf00) 00010000:00010000:0.0:1788582113.551734:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582113.551740:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a789d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.551746:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a789d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582113.552117:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582113.552158:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002029184 00000100:00100000:0.0:1788582113.552169:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002029184 00000100:00100000:0.0:1788582113.552503:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 194 00000100:00100000:0.0:1788582113.552514:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+31:11052:x1875464002029184:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:0.0:1788582113.552539:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582113.552558:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a78a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c93be expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.552639:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a78a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93be expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.552654:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a78a4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93be expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.552685:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdf00) 00010000:00010000:0.0:1788582113.552689:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788582113.552693:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7089c00, rc 0) 00000100:00100000:0.0:1788582113.552758:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83087800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+32:11052:x1875464002029184:12345-192.168.201.12@tcp:101:bash.0 Request processed in 246us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582113.552765:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 194 00000100:00100000:0.0:1788582113.554574:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582113.554717:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002029312 00000100:00100000:1.0:1788582113.554727:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002029312 00000100:00100000:1.0:1788582113.554813:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 58 00000100:00100000:1.0:1788582113.554823:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+7:11052:x1875464002029312:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:1.0:1788582113.554839:0:6692:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582113.554862:0:6692:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c48b440/0x2bc3aa892c3a78ab lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c93c5 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788582113.554890:0:6692:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9b98df, atime: 0x6a9b98dd, ctime: 0x6a9b98df, blocks: 0xb 00010000:00010000:1.0:1788582113.554911:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=332s v=(0 0) 00010000:00010000:1.0:1788582113.554916:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582113.554923:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c48b440/0x2bc3aa892c3a78ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93c5 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.554941:0:6692:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009c48b440/0x2bc3aa892c3a78ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93c5 expref: 8 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.554953:0:6692:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fce00, rc 0) 00000100:00100000:1.0:1788582113.555005:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb6b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+8:11052:x1875464002029312:12345-192.168.201.12@tcp:101:bash.0 Request processed in 184us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582113.555012:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 58 00000100:00100000:2.0:1788582113.556752:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582113.556798:0:6698:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002029440 00000100:00100000:1.0:1788582113.556819:0:6698:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002029440 00002000:00010000:1.0:1788582113.556850:0:6698:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1788582113.556853:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0c83084e00 with x1875464002029440 ext(0->18446744073709551615) 00002000:00010000:1.0:1788582113.556862:0:6698:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0c83084e00. 00000100:00100000:1.0:1788582113.556887:0:6698:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 5 00000100:00100000:1.0:1788582113.556897:0:6698:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b99087a3-3c83-4416-b2b9-d522b9885111+8:2350:x1875464002029440:12345-192.168.201.12@tcp:10:bash.0 00002000:00010000:1.0:1788582113.557227:0:6698:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788582113.557231:0:6698:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1788582111 -> 1788582113 00002000:00010000:1.0:1788582113.557234:0:6698:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1788582109 -> 1788582109 00002000:00010000:1.0:1788582113.557236:0:6698:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1788582111 -> 1788582113 00002000:00010000:1.0:1788582113.557238:0:6698:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788582113.557297:0:6698:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83084e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b99087a3-3c83-4416-b2b9-d522b9885111+9:2350:x1875464002029440:12345-192.168.201.12@tcp:10:bash.0 Request processed in 402us (551us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788582113.557305:0:6698:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 5 00002000:00010000:1.0:1788582113.557309:0:6698:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1788582113.557311:0:6698:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0c83084e00 with x1875464002029440 ext(0->18446744073709551615) 00002000:00010000:1.0:1788582113.557316:0:6698:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0c83084e00. 00000100:00100000:1.0:1788582113.596630:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582113.596744:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002029568 00000100:00100000:3.0:1788582113.596755:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002029568 00000100:00100000:3.0:1788582113.596815:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 195 00000100:00100000:3.0:1788582113.596826:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+32:11532:x1875464002029568:12345-192.168.201.12@tcp:34:lfs.0 00010000:00010000:2.0:1788582113.597426:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a78b2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597442:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a78b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597454:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a78b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597469:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a78b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597476:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a78b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597498:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a78b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597732:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a78c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597738:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a78c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597743:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a78c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788582113.597779:0:10137:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a78c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597787:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a78b2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597791:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a78b2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597796:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a78b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597800:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582113.597803:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a78b2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597807:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a78b2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597815:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:2.0:1788582113.597823:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582113.597828:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a78b2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597832:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a78b2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597842:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a78b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597845:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a78b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597848:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a78b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597852:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04e00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582113.597853:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a78b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597856:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a78b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597860:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d0d85afcd00) 00010000:00010000:2.0:1788582113.597862:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582113.597863:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a78b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597866:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a78b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597875:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a78c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597882:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a78c0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597887:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a78c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597891:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582113.597894:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a78c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597900:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a78c0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597907:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdf00) 00010000:00010000:2.0:1788582113.597909:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582113.597912:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a78c0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.597918:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a78c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582113.597995:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+32:11532:x1875464002029568:12345-192.168.201.12@tcp:34:lfs.0 Request processed in 1169us (1374us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582113.598005:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 195 00000100:00100000:0.0:1788582113.620085:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582113.620142:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002029824 00000100:00100000:1.0:1788582113.620199:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002029824 00000100:00100000:1.0:1788582113.620301:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 196 00000100:00100000:1.0:1788582113.620311:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabb6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+32:11535:x1875464002029824:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:1.0:1788582113.620331:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582113.620352:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a78c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c93cc expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.620450:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a78ce lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.620465:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a78ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.620476:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a78ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.620490:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a78d5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.620497:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a78d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.620504:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a78d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.620773:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a78dc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.620780:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a78dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.620785:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a78dc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582113.620793:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788582113.620868:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a78ce lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.620873:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a78ce lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.620881:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a78ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.620896:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fda00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582113.620899:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a78ce lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.620905:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a78ce lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.620915:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:1.0:1788582113.620917:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582113.620920:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a78ce lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.620924:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a78ce lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.620933:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a78d5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.620936:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a78d5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.620940:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a78d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.620943:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fc000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582113.620944:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a78d5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.620954:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a78d5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.620959:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d0da2faf600) 00010000:00010000:1.0:1788582113.620961:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582113.620962:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a78d5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.620965:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a78d5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.621000:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a78c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93cc expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.621008:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a78dc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93cc expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.621013:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdf00) 00010000:00010000:1.0:1788582113.621014:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788582113.621016:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fd400, rc 0) 00000100:00100000:1.0:1788582113.621086:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabb6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+34:11535:x1875464002029824:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 776us (1009us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1788582113.621094:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 196 00000100:00100000:1.0:1788582113.623300:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582113.623408:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002029952 00000100:00100000:0.0:1788582113.623418:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002029952 00000100:00100000:0.0:1788582113.623475:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 197 00000100:00100000:0.0:1788582113.623483:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+34:11535:x1875464002029952:12345-192.168.201.12@tcp:54:lfs.0 00010000:00010000:0.0:1788582113.623538:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a78ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.623549:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a788f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93b7 expref: 34 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.623554:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a78ea lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.623596:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a788f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93b7 expref: 34 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.623609:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a788f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93b7 expref: 34 pid: 10137 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582113.623624:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbd92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875464020893056:192.168.201.12@tcp:104: 00000100:00100000:0.0:1788582113.623734:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8d8240 going to sleep for 11 seconds 00000100:00100000:0.0:1788582113.625455:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbd92a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5844:1875464020893056:192.168.201.12@tcp:104: 00010000:00010000:0.0:1788582113.625480:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a78ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582113.630613:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582113.630658:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582113.630766:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002030464 00000100:00100000:3.0:1788582113.630776:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002030464 00000100:00100000:3.0:1788582113.630858:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 59 00000100:00100000:3.0:1788582113.630869:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+9:2352:x1875464002030464:12345-192.168.201.12@tcp:16:kworker.0 00000100:00100000:0.0:1788582113.631836:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002030208 00000100:00100000:0.0:1788582113.631843:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002030208 00000100:00100000:0.0:1788582113.631923:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 52 00000100:00100000:0.0:1788582113.631932:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+35:5586:x1875464002030208:12345-192.168.201.12@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788582113.632592:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+36:5586:x1875464002030208:12345-192.168.201.12@tcp:35:ldlm_bl.0 Request processed in 658us (1987us total) trans 4294967477 rc 0/0 00000100:00100000:0.0:1788582113.632601:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 52 00000100:00100000:1.0:1788582113.640228:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582113.641115:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002030336 00000100:00100000:3.0:1788582113.641126:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002030336 00002000:00100000:3.0:1788582113.641176:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->7) req@ffff8d0dbbdc0e00 x1875464002030336/t0(0) o4->b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp:714/0 lens 496/0 e 0 to 0 dl 1788582124 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788582113.641187:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0dbbdc0e00 with x1875464002030336 ext(0->7) 00002000:00010000:3.0:1788582113.641193:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0dbbdc0e00 00000100:00100000:3.0:1788582113.641260:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 6 00000100:00100000:3.0:1788582113.641272:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b99087a3-3c83-4416-b2b9-d522b9885111+10:2351:x1875464002030336:12345-192.168.201.12@tcp:4:bash.0 00000100:00100000:3.0:1788582113.644968:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b99087a3-3c83-4416-b2b9-d522b9885111+12:2351:x1875464002030336:12345-192.168.201.12@tcp:4:bash.0 Request processed in 3688us (4768us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788582113.644983:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 6 00002000:00100000:3.0:1788582113.644993:0:6696:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->7) req@ffff8d0dbbdc0e00 x1875464002030336/t4294967319(0) o4->b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp:714/0 lens 496/448 e 0 to 0 dl 1788582124 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788582113.645003:0:6696:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0dbbdc0e00 with x1875464002030336 ext(0->7) 00002000:00010000:3.0:1788582113.645010:0:6696:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0dbbdc0e00 00000100:00100000:2.0:1788582113.645415:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582113.645851:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002030592 00000100:00100000:3.0:1788582113.645860:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002030592 00010000:00010000:3.0:1788582113.645900:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a788f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93b7 expref: 36 pid: 10137 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582113.645941:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 77 00000100:00100000:3.0:1788582113.645951:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da7247c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+36:2350:x1875464002030592:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582113.645964:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582113.645971:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a788f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93b7 expref: 36 pid: 10137 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.645984:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a788f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93b7 expref: 36 pid: 10137 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.646009:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a788f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93b7 expref: 36 pid: 10137 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.646025:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdf00) 00010000:00010000:3.0:1788582113.646030:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a78ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.646040:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a78ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.646047:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a78ea lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.646073:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582113.646110:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da7247c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+35:2350:x1875464002030592:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 160us (696us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582113.646126:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 77 00010000:00010000:3.0:1788582113.646186:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a78ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.646194:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a78ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.646569:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a78ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.646577:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a78ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.646583:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a78ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.646590:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089e00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582113.646594:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a78ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.646601:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a78ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.646610:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdf00) 00010000:00010000:3.0:1788582113.646612:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788582113.646616:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a78ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.646621:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a78ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582113.646661:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+34:11535:x1875464002029952:12345-192.168.201.12@tcp:54:lfs.0 Request processed in 23177us (23370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582113.646686:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 197 00000100:00100000:3.0:1788582113.649419:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582113.649498:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002030848 00000100:00100000:0.0:1788582113.649508:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002030848 00000100:00100000:0.0:1788582113.649578:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 53 00000100:00100000:0.0:1788582113.649589:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+34:11535:x1875464002030848:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:0.0:1788582113.649865:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+35:11535:x1875464002030848:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 276us (458us total) trans 4294967478 rc 0/0 00000100:00100000:0.0:1788582113.649898:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 53 00000001:00080000:0.0:1788582113.721120:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:0.0:1788582113.721137:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000100:00100000:2.0:1788582113.721378:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+9:2352:x1875464002030464:12345-192.168.201.12@tcp:16:kworker.0 Request processed in 90503us (90712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582113.721391:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 59 00000100:00100000:3.0:1788582113.769094:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582113.769247:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002031104 00000100:00100000:2.0:1788582113.769269:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002031104 00000100:00100000:3.0:1788582113.769493:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 198 00000100:00100000:3.0:1788582113.769502:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbad3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+35:11546:x1875464002031104:12345-192.168.201.12@tcp:101:cat.0 00010000:00010000:3.0:1788582113.769528:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582113.769548:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a78f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c93d3 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.769619:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a78f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.769633:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a78f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.769645:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a78f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.769666:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a78ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.769682:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a78ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.769690:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a78ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.769908:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7906 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.769928:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.769934:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582113.769944:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1788582113.770034:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a78f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.770040:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a78f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.770047:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a78f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.770053:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582113.770057:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a78f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.770065:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a78f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.770078:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:3.0:1788582113.770081:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582113.770085:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a78f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.770091:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a78f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.770103:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a78ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.770116:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a78ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.770121:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a78ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.770127:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582113.770130:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a78ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.770135:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a78ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.770144:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d0d917bd100) 00010000:00010000:3.0:1788582113.770146:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582113.770150:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a78ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.770155:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a78ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.770868:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a78f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93d3 expref: 38 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.770899:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7906 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93d3 expref: 37 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.770908:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdf00) 00010000:00010000:3.0:1788582113.770910:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788582113.770921:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26000, rc 0) 00000100:00100000:3.0:1788582113.771058:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbad3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+37:11546:x1875464002031104:12345-192.168.201.12@tcp:101:cat.0 Request processed in 1554us (1975us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1788582113.771067:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 198 00000100:00100000:2.0:1788582113.785565:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582113.785957:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002031360 00000100:00100000:2.0:1788582113.785968:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002031360 00000100:00100000:2.0:1788582113.786022:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 54 00000100:00100000:2.0:1788582113.786032:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+37:11546:x1875464002031360:12345-192.168.201.12@tcp:35:cat.0 00000100:00100000:2.0:1788582113.786373:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+38:11546:x1875464002031360:12345-192.168.201.12@tcp:35:cat.0 Request processed in 343us (818us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788582113.786381:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 54 00000100:00100000:3.0:1788582113.811093:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582113.811134:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002031616 00000100:00100000:3.0:1788582113.811144:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002031616 00000100:00100000:3.0:1788582113.811197:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 199 00000100:00100000:3.0:1788582113.811227:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+38:11547:x1875464002031616:12345-192.168.201.12@tcp:36:rm.0 00010000:00010000:3.0:1788582113.811286:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788582113.811315:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7906 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93d3 expref: 38 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.811337:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a78dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93cc expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.811349:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a78a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93be expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.811359:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdf00) 00010000:00010000:3.0:1788582113.811370:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788582113.811388:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7914 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.811404:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7914 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.811411:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7914 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.811433:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a791b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.811439:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a791b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.811453:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a791b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.811643:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7922 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.811650:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7922 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.811655:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7922 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788582113.812184:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:3.0:1788582113.812192:0:5843:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 332805989165ns, next at 333805986886ns, rc = 0 00010000:00010000:3.0:1788582113.812258:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7929 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812264:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7929 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812270:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7929 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812275:0:5843:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7929 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812287:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7929 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812292:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7929 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812304:0:5843:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788582113.812320:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7922 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812323:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7922 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812327:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7922 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812331:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582113.812334:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7922 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812339:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7922 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812345:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdb00) 00010000:00010000:3.0:1788582113.812347:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788582113.812349:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7922 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812352:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7922 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812363:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7914 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812370:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7914 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812374:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7914 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812377:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582113.812378:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7914 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812382:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7914 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812386:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:3.0:1788582113.812387:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582113.812389:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7914 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812392:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7914 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788582113.812397:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001472aff2 reply state 000000002640820c transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a791b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582113.812403:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788582113.812473:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d12a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+37:11547:x1875464002031616:12345-192.168.201.12@tcp:36:rm.0 Request processed in 1247us (1388us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788582113.812481:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 199 00010000:00010000:3.0:1788582113.812515:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788582113.812520:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7929 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812528:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26800 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:3.0:1788582113.812531:0:7637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7929 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812535:0:7637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7929 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812540:0:7637:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff8d0d917bdb00) 00010000:00010000:3.0:1788582113.812541:0:7637:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788582113.812543:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7929 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812546:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7929 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.812555:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582113.812556:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582113.812557:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582113.814834:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a791b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.814850:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a791b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.814856:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a791b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.814862:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582113.814867:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a791b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.814874:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a791b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.814888:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d0d917bd100) 00010000:00010000:0.0:1788582113.814891:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582113.814895:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a791b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.814900:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a791b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788582113.831506:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000001:00080000:3.0:1788582113.831524:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:3.0:1788582113.831533:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000100:00100000:3.0:1788582113.848579:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582113.848900:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002031872 00000100:00100000:0.0:1788582113.848914:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002031872 00000100:00100000:0.0:1788582113.849053:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 200 00000100:00100000:0.0:1788582113.849064:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac38dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+36:11553:x1875464002031872:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:0.0:1788582113.849106:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582113.849129:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7930 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c93da expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.849776:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7937 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.849800:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7937 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.849812:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7937 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.849827:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a793e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.849833:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a793e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.849839:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a793e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788582113.850738:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1788582113.850914:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a7945 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.851088:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a7945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.851101:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a7945 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.851140:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7937 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.851147:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7937 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.851154:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7937 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.851168:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fc000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582113.851172:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7937 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.851179:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7937 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.851193:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:1.0:1788582113.851195:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582113.851875:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7937 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.851887:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7937 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788582113.851904:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002c213f0e reply state 000000007be6d478 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a793e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582113.851913:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788582113.851966:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089c00/0x2bc3aa892c3a7930 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93da expref: 39 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.851983:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a7945 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93da expref: 38 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.851992:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf800) 00010000:00010000:1.0:1788582113.851995:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788582113.851998:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fd600, rc 0) 00000100:00100000:1.0:1788582113.852180:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac38dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+39:11553:x1875464002031872:12345-192.168.201.12@tcp:101:bash.0 Request processed in 3117us (3745us total) trans 4294967482 rc 0/0 00000100:00100000:1.0:1788582113.852197:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 200 00010000:00010000:0.0:1788582113.854835:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a793e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.854852:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a793e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.854860:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a793e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.854866:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fda00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582113.854871:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a793e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.854879:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a793e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.854897:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d0da2faf600) 00010000:00010000:0.0:1788582113.854900:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582113.854904:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a793e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582113.854910:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a793e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582113.861330:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582113.861626:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002032000 00000100:00100000:2.0:1788582113.861637:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002032000 00000100:00100000:2.0:1788582113.861733:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 60 00000100:00100000:2.0:1788582113.861744:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+5:2351:x1875464002032000:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:2.0:1788582113.861764:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:3.0:1788582113.861784:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788582113.861787:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fe30e3d9/0x2bc3aa892c3a7953 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c93e1 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788582113.861815:0:6693:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788582113.861835:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=332s v=(0 0) 00010000:00010000:2.0:1788582113.861839:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788582113.861849:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fe30e3d9/0x2bc3aa892c3a7953 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e1 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.861870:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fe30e3d9/0x2bc3aa892c3a7953 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e1 expref: 6 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582113.861885:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05000, rc 0) 00000100:00100000:2.0:1788582113.861966:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+6:2351:x1875464002032000:12345-192.168.201.12@tcp:101:bash.0 Request processed in 224us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582113.861973:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 60 00000100:00100000:3.0:1788582113.871529:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582113.871633:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002032128 00000100:00100000:1.0:1788582113.871645:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002032128 00000100:00100000:1.0:1788582113.871728:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 61 00000100:00100000:1.0:1788582113.871740:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+6:11553:x1875464002032128:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:1.0:1788582113.871760:0:8034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582113.871779:0:8034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003aa99c53/0x2bc3aa892c3a795a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c93e8 expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.871815:0:8034:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe30e3d9/0x2bc3aa892c3a7953 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e1 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.871825:0:8034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582113.871830:0:8034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582113.871835:0:8034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003aa99c53/0x2bc3aa892c3a795a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e8 expref: 7 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.871872:0:8034:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe30e3d9/0x2bc3aa892c3a7953 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e1 expref: 7 pid: 6693 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.871887:0:8034:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe30e3d9/0x2bc3aa892c3a7953 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e1 expref: 7 pid: 6693 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582113.871903:0:8034:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8034:1875464020893184:192.168.201.12@tcp:104: 00000100:00100000:1.0:1788582113.872018:0:8034:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da791de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788582113.873849:0:8034:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8034:1875464020893184:192.168.201.12@tcp:104: 00010000:00010000:1.0:1788582113.873884:0:8034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003aa99c53/0x2bc3aa892c3a795a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e8 expref: 7 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582113.873904:0:8034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fc000, rc 0) 00000100:00100000:1.0:1788582113.874154:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+7:11553:x1875464002032128:12345-192.168.201.12@tcp:101:bash.0 Request processed in 2415us (2634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582113.874163:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 61 00000100:00100000:2.0:1788582113.884528:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582113.886419:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002032256 00000100:00100000:3.0:1788582113.886435:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002032256 00010000:00010000:3.0:1788582113.886599:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe30e3d9/0x2bc3aa892c3a7953 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e1 expref: 7 pid: 6693 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582113.886745:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 78 00000100:00100000:3.0:1788582113.886759:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83085f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+7:2349:x1875464002032256:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582113.886777:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582113.886808:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe30e3d9/0x2bc3aa892c3a7953 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e1 expref: 7 pid: 6693 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.886826:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe30e3d9/0x2bc3aa892c3a7953 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e1 expref: 7 pid: 6693 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.886864:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe30e3d9/0x2bc3aa892c3a7953 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e1 expref: 7 pid: 6693 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.886886:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582113.886891:0:5829:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582113.886900:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003aa99c53/0x2bc3aa892c3a795a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e8 expref: 6 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.886910:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003aa99c53/0x2bc3aa892c3a795a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e8 expref: 6 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582113.886965:0:5829:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003aa99c53/0x2bc3aa892c3a795a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e8 expref: 6 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582113.886980:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90c16300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1875464020893312:192.168.201.12@tcp:105: 00000100:00100000:3.0:1788582113.887089:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d84cfdb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788582113.895043:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90c16300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5829:1875464020893312:192.168.201.12@tcp:105: 00010000:00010000:3.0:1788582113.895076:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582113.895135:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83085f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+6:2349:x1875464002032256:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 8379us (10618us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582113.895145:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 78 00000100:00100000:2.0:1788582113.895427:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582113.895865:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002032512 00000100:00100000:3.0:1788582113.895873:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002032512 00000100:00100000:3.0:1788582113.895930:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 55 00000100:00100000:3.0:1788582113.895940:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+38:11553:x1875464002032512:12345-192.168.201.12@tcp:35:bash.0 00000100:00100000:3.0:1788582113.896417:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+39:11553:x1875464002032512:12345-192.168.201.12@tcp:35:bash.0 Request processed in 478us (989us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1788582113.896425:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 55 00010000:00010000:2.0:1788582114.029371:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582114.050627:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582114.050866:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002032640 00000100:00100000:3.0:1788582114.050876:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002032640 00000100:00100000:3.0:1788582114.050947:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 201 00000100:00100000:3.0:1788582114.050958:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+39:11569:x1875464002032640:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:3.0:1788582114.050985:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582114.051016:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7961 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c93ef expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.051098:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7968 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.051114:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.051144:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582114.051181:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788582114.051185:0:10137:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788582114.051236:0:10137:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7968 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.051262:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7961 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93ef expref: 41 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.051281:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7968 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93ef expref: 40 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.051290:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:3.0:1788582114.051293:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788582114.051297:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27400, rc 0) 00000100:00100000:3.0:1788582114.051371:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83086d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+40:11569:x1875464002032640:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 415us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582114.051379:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 201 00000100:00100000:0.0:1788582114.057827:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582114.057919:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002032896 00000100:00100000:3.0:1788582114.058412:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002032896 00000100:00100000:3.0:1788582114.058838:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 202 00000100:00100000:3.0:1788582114.058850:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+40:11569:x1875464002032896:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:3.0:1788582114.058876:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582114.058901:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a796f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c93f6 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.059370:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7976 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.059385:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.059396:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582114.059407:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788582114.059869:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a796f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93f6 expref: 43 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.059888:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93f6 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.059898:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf800) 00010000:00010000:3.0:1788582114.059901:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788582114.059904:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26000, rc 0) 00000100:00100000:3.0:1788582114.060955:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+42:11569:x1875464002032896:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 2101us (3132us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1788582114.060967:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 202 00000100:00100000:0.0:1788582114.071555:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582114.071609:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582114.071834:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002033280 00000100:00100000:3.0:1788582114.071844:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002033280 00000100:00100000:3.0:1788582114.071922:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 13 00000100:00100000:3.0:1788582114.071934:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+42:2351:x1875464002033280:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582114.071951:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582114.071988:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7976 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93f6 expref: 42 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.072005:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf800) 00010000:00010000:3.0:1788582114.072010:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582114.072087:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a0a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+41:2351:x1875464002033280:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 156us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582114.072095:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 13 00000100:00100000:1.0:1788582114.074250:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002033152 00000100:00100000:1.0:1788582114.074265:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002033152 00000100:00100000:1.0:1788582114.074321:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 203 00000100:00100000:1.0:1788582114.074330:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+41:11569:x1875464002033152:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:1.0:1788582114.074355:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582114.074377:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a7984 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c93fd expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.074469:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a798b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.074484:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a798b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.074495:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a798b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582114.074507:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788582114.074629:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a7984 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93fd expref: 44 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.074675:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a798b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93fd expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.074684:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf800) 00010000:00010000:1.0:1788582114.074687:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788582114.074691:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fda00, rc 0) 00000100:00100000:1.0:1788582114.074759:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+43:11569:x1875464002033152:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 429us (3216us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1788582114.074766:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 203 00000100:00100000:0.0:1788582114.083389:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582114.083716:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002033408 00000100:00100000:2.0:1788582114.083727:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002033408 00000100:00100000:2.0:1788582114.083789:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 62 00000100:00100000:2.0:1788582114.083801:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabdd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+6:2349:x1875464002033408:12345-192.168.201.12@tcp:1:lfs.0 00010000:00010000:2.0:1788582114.083849:0:6693:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a7999 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.083873:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003aa99c53/0x2bc3aa892c3a795a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e8 expref: 6 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.083881:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788582114.083885:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788582114.083890:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a7999 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.083930:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003aa99c53/0x2bc3aa892c3a795a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e8 expref: 6 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.083944:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003aa99c53/0x2bc3aa892c3a795a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e8 expref: 6 pid: 8034 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582114.083980:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c83084000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1875464020893440:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582114.084074:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c837a5000 going to sleep for 11 seconds 00000100:00100000:0.0:1788582114.086877:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582114.087001:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002033536 00000100:00100000:1.0:1788582114.087012:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002033536 00002000:00100000:1.0:1788582114.087077:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8d0dbab21c00 x1875464002033536/t0(0) o4->b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp:715/0 lens 504/0 e 0 to 0 dl 1788582125 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788582114.087090:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0dbab21c00 with x1875464002033536 ext(0->8) 00010000:00010000:1.0:1788582114.087099:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003aa99c53/0x2bc3aa892c3a795a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e8 expref: 7 pid: 8034 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.087116:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003aa99c53/0x2bc3aa892c3a795a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e8 expref: 7 pid: 8034 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788582114.087124:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d0dbab21c00 00000100:00100000:1.0:1788582114.087172:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 3 00000100:00100000:1.0:1788582114.087184:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b99087a3-3c83-4416-b2b9-d522b9885111+7:2349:x1875464002033536:12345-192.168.201.12@tcp:4:lfs.0 00000100:00100000:1.0:1788582114.087970:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b99087a3-3c83-4416-b2b9-d522b9885111+9:2349:x1875464002033536:12345-192.168.201.12@tcp:4:lfs.0 Request processed in 785us (1113us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788582114.087985:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 3 00002000:00100000:1.0:1788582114.087994:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff8d0dbab21c00 x1875464002033536/t4294967308(0) o4->b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp:715/0 lens 504/448 e 0 to 0 dl 1788582125 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788582114.088003:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0dbab21c00 with x1875464002033536 ext(0->8) 00010000:00010000:1.0:1788582114.088010:0:6697:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003aa99c53/0x2bc3aa892c3a795a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e8 expref: 9 pid: 8034 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.088024:0:6697:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003aa99c53/0x2bc3aa892c3a795a lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e8 expref: 9 pid: 8034 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788582114.088031:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff8d0dbab21c00 00000100:00100000:2.0:1788582114.088619:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c83084000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6693:1875464020893440:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582114.088645:0:6693:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a7999 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582114.099331:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582114.100091:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002033664 00000100:00100000:1.0:1788582114.100101:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002033664 00010000:00010000:1.0:1788582114.100147:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003aa99c53/0x2bc3aa892c3a795a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e8 expref: 9 pid: 8034 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582114.100236:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 79 00000100:00100000:1.0:1788582114.100247:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+9:2352:x1875464002033664:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788582114.100264:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788582114.100286:0:7636:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1788582114.100290:0:7636:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788582113 00002000:00010000:1.0:1788582114.100292:0:7636:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788582113 00002000:00010000:1.0:1788582114.100294:0:7636:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788582113 00010000:00010000:1.0:1788582114.100301:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003aa99c53/0x2bc3aa892c3a795a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e8 expref: 9 pid: 8034 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.100336:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003aa99c53/0x2bc3aa892c3a795a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e8 expref: 9 pid: 8034 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.100362:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003aa99c53/0x2bc3aa892c3a795a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93e8 expref: 9 pid: 8034 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.100378:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788582114.100383:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788582114.100388:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a7999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.100397:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a7999 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.100430:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788582114.101759:0:6693:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a7999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.101775:0:6693:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a7999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.101809:0:6693:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a7999 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.101818:0:6693:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a7999 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.101827:0:6693:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a7999 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.101833:0:6693:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04a00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582114.101838:0:6693:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a7999 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.101868:0:6693:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a7999 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.101886:0:6693:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a7999 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.101894:0:6693:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003a884617/0x2bc3aa892c3a7999 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582114.102174:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab23100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+8:2352:x1875464002033664:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 1925us (2854us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582114.102184:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 79 00000100:00100000:2.0:1788582114.102717:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabdd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+7:2349:x1875464002033408:12345-192.168.201.12@tcp:1:lfs.0 Request processed in 18918us (19339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582114.102726:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 62 00000100:00100000:0.0:1788582114.106153:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582114.106353:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002033920 00000100:00100000:1.0:1788582114.106364:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002033920 00000100:00100000:1.0:1788582114.106419:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 56 00000100:00100000:1.0:1788582114.106429:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d84ecc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+43:11569:x1875464002033920:12345-192.168.201.12@tcp:35:lfs.0 00000004:00010000:1.0:1788582114.106806:0:10138:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a798b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93fd expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788582114.108131:0:10138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1788582114.108198:0:10138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1788582114.109651:0:10138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1788582114.109754:0:10138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a79a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.109776:0:10138:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a7945 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93da expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.109785:0:10138:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a79a0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.109825:0:10138:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a7945 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93da expref: 47 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.109843:0:10138:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a7945 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93da expref: 47 pid: 5844 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582114.109857:0:10138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:10138:1875464020893568:192.168.201.12@tcp:104: 00000100:00100000:1.0:1788582114.110826:0:10138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da791de40 going to sleep for 11 seconds 00000100:00100000:0.0:1788582114.118482:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582114.118973:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002034048 00000100:00100000:3.0:1788582114.118985:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002034048 00010000:00010000:3.0:1788582114.119105:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a7945 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93da expref: 48 pid: 5844 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582114.119464:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 80 00000100:00100000:3.0:1788582114.119476:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+48:2350:x1875464002034048:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582114.119493:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582114.119500:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a7945 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93da expref: 48 pid: 5844 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.119515:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a7945 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93da expref: 48 pid: 5844 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.119539:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf800) 00010000:00010000:3.0:1788582114.119545:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a79a0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.119555:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a79a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.119580:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a79a0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.119598:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582114.119652:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab22680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+48:2350:x1875464002034048:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 179us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582114.119705:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 80 00010000:00010000:1.0:1788582114.122294:0:10138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a7945 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93da expref: 47 pid: 5844 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582114.122318:0:10138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:10138:1875464020893568:192.168.201.12@tcp:104: 00010000:00010000:1.0:1788582114.122345:0:10138:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a79a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.122375:0:10138:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a79a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.122380:0:10138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a79a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788582114.122536:0:10138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788582114.122763:0:10138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1788582114.122879:0:10138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:10138:1875464020893696:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1788582114.124305:0:10138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582114.124339:0:10138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da791d240 going to sleep for 11 seconds 00000100:00100000:1.0:1788582114.124375:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020893696 00000100:00100000:1.0:1788582114.124383:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020893696 00000100:00100000:1.0:1788582114.124432:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788582114.124441:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10138:x1875464020893696:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1788582114.124517:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10138:x1875464020893696:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 77us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582114.124524:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788582114.124560:0:10138:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1788582114.124566:0:10138:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1788582114.124583:0:10138:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d0c83087480, transno 4294967307 00000100:00100000:1.0:1788582114.124596:0:10138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:10138:1875464020893696:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1788582114.125970:0:10138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1788582114.126324:0:10138:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:10138:1875464020893824:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1788582114.126378:0:10138:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582114.126407:0:10138:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da791de40 going to sleep for 11 seconds 00000100:00100000:1.0:1788582114.126440:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020893824 00000100:00100000:1.0:1788582114.126446:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020893824 00000100:00100000:1.0:1788582114.126482:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788582114.126489:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:10138:x1875464020893824:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:1.0:1788582114.126645:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:10138:x1875464020893824:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 154us (265us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788582114.126652:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788582114.126711:0:10138:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:10138:1875464020893824:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:1.0:1788582114.126767:0:10138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1788582114.126803:0:10138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a79a0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.126814:0:10138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a79a0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.126826:0:10138:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a79a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.126832:0:10138:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fc800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582114.126836:0:10138:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a79a0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.126842:0:10138:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a79a0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.126859:0:10138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf800) 00010000:00010000:1.0:1788582114.126862:0:10138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788582114.126867:0:10138:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a79a0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.126873:0:10138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a79a0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788582114.128506:0:10138:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788582114.128599:0:10138:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1788582114.128611:0:10138:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 333122408119ns, next at 334122405824ns, rc = 0 00000001:00080000:1.0:1788582114.128620:0:10138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788582114.128723:0:10138:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf800) 00010000:00010000:1.0:1788582114.128728:0:10138:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788582114.128737:0:10138:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a798b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93fd expref: 51 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582114.129313:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d84ecc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+50:11569:x1875464002033920:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 22882us (23166us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788582114.129326:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 56 00000020:00080000:1.0:1788582114.129333:0:10138:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788582114.136082:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582114.136176:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002034176 00000100:00100000:1.0:1788582114.136186:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002034176 00000100:00100000:1.0:1788582114.136279:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 204 00000100:00100000:1.0:1788582114.136290:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+50:11569:x1875464002034176:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:1.0:1788582114.136315:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582114.136340:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a79a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9404 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.136409:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a79a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9404 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.136423:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a79a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9404 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.136784:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:1.0:1788582114.136787:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788582114.136791:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fd600, rc 0) 00000100:00100000:1.0:1788582114.136856:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+51:11569:x1875464002034176:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 567us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582114.136897:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 204 00000100:00100000:0.0:1788582114.144152:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582114.144258:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002034432 00000100:00100000:2.0:1788582114.144272:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002034432 00000100:00100000:2.0:1788582114.144333:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 57 00000100:00100000:2.0:1788582114.144344:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+51:11569:x1875464002034432:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:2.0:1788582114.144604:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+52:11569:x1875464002034432:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 262us (462us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1788582114.144612:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 57 00000100:00100000:2.0:1788582114.257025:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582114.257170:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002034560 00000100:00100000:3.0:1788582114.257180:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002034560 00000100:00100000:3.0:1788582114.257278:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 205 00000100:00100000:3.0:1788582114.257289:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+52:11579:x1875464002034560:12345-192.168.201.12@tcp:34:lfs.0 00010000:00010000:3.0:1788582114.257374:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a79ae lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257393:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a79ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257404:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a79ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257418:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a79b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257424:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a79b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257631:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a79b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257741:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257763:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257770:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788582114.257813:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257826:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a79ae lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257833:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a79ae lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257840:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a79ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257846:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582114.257850:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a79ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257857:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a79ae lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257869:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:3.0:1788582114.257872:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582114.257877:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a79ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257883:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a79ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257905:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a79b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257912:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a79b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257918:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a79b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257923:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582114.257926:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a79b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257932:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a79b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257940:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d0d917bdb00) 00010000:00010000:3.0:1788582114.257943:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582114.257946:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a79b5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257952:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a79b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257968:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257973:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257978:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257990:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582114.257993:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.257999:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.258007:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:3.0:1788582114.258010:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582114.258013:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.258018:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582114.258323:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83087480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+52:11579:x1875464002034560:12345-192.168.201.12@tcp:34:lfs.0 Request processed in 1033us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582114.258332:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 205 00000100:00100000:0.0:1788582114.310168:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582114.310249:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002034816 00000100:00100000:3.0:1788582114.310259:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002034816 00000100:00100000:3.0:1788582114.310308:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 206 00000100:00100000:3.0:1788582114.310315:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+52:11582:x1875464002034816:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:3.0:1788582114.310334:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582114.310351:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c940b expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310409:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a79ca lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310447:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a79ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310455:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a79ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310466:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a79d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310470:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a79d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310474:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a79d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310567:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a79d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310572:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a79d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310578:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a79d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582114.310588:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788582114.310706:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a79ca lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310713:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a79ca lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310720:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a79ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310732:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582114.310737:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a79ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310744:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a79ca lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310753:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:3.0:1788582114.310755:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582114.310758:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a79ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310762:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a79ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310772:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a79d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310775:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a79d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310779:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a79d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310782:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582114.310783:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a79d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310787:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a79d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310797:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d0d917bdb00) 00010000:00010000:3.0:1788582114.310799:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582114.310801:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a79d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310804:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a79d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310833:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c940b expref: 55 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310841:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a79d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c940b expref: 54 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.310845:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:3.0:1788582114.310846:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788582114.310848:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27200, rc 0) 00000100:00100000:3.0:1788582114.310915:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+54:11582:x1875464002034816:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 599us (766us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1788582114.310923:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 206 00000100:00100000:2.0:1788582114.315504:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582114.315635:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002034944 00000100:00100000:3.0:1788582114.315646:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002034944 00000100:00100000:3.0:1788582114.315724:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 207 00000100:00100000:3.0:1788582114.315735:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+54:11582:x1875464002034944:12345-192.168.201.12@tcp:54:lfs.0 00010000:00010000:3.0:1788582114.315814:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a79e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.315832:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a79e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.315856:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a79e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.315885:0:10136:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a79e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.315892:0:10136:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a79e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.315899:0:10136:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a79e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.315904:0:10136:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582114.315909:0:10136:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a79e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.315916:0:10136:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a79e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.315928:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:3.0:1788582114.315931:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788582114.315935:0:10136:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a79e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.315941:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a79e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582114.316023:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83084000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+54:11582:x1875464002034944:12345-192.168.201.12@tcp:54:lfs.0 Request processed in 288us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582114.316031:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 207 00000100:00100000:0.0:1788582114.328746:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582114.328843:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002035200 00000100:00100000:1.0:1788582114.328854:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002035200 00000100:00100000:1.0:1788582114.328914:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 58 00000100:00100000:1.0:1788582114.328926:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+54:11582:x1875464002035200:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:1.0:1788582114.329239:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+55:11582:x1875464002035200:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 315us (504us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788582114.329247:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 58 00000100:00100000:0.0:1788582114.456594:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582114.456748:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002035456 00000100:00100000:3.0:1788582114.456759:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002035456 00000100:00100000:3.0:1788582114.456869:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 208 00000100:00100000:3.0:1788582114.456880:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+55:11592:x1875464002035456:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:3.0:1788582114.456912:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582114.456928:0:5845:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788582114.456961:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7968 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93ef expref: 55 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.456980:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:3.0:1788582114.456985:0:5845:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788582114.456999:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a79ed lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9412 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.457137:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.457151:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.457161:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582114.457171:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788582114.457424:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a79ed lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9412 expref: 57 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.457439:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9412 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.457460:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:3.0:1788582114.457463:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788582114.457466:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26800, rc 0) 00000100:00100000:3.0:1788582114.457532:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+56:11592:x1875464002035456:12345-192.168.201.12@tcp:101:bash.0 Request processed in 653us (953us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788582114.457539:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 208 00000100:00100000:0.0:1788582114.462926:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582114.463021:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582114.463436:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002035840 00000100:00100000:1.0:1788582114.463447:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002035840 00000100:00100000:1.0:1788582114.463512:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 209 00000100:00100000:1.0:1788582114.463522:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+56:11592:x1875464002035840:12345-192.168.201.12@tcp:36:bash.0 00010000:00010000:1.0:1788582114.463577:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582114.463605:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a79d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c940b expref: 56 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.463625:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:1.0:1788582114.463629:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788582114.463842:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a7a02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.463876:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9412 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.463885:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a7a02 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.463984:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9412 expref: 56 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.464000:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9412 expref: 56 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582114.464291:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002035584 00000100:00100000:3.0:1788582114.464297:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002035584 00010000:00010000:3.0:1788582114.464331:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79f4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9412 expref: 57 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582114.464364:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 81 00000100:00100000:3.0:1788582114.464372:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+57:2352:x1875464002035584:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582114.464382:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582114.464387:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79f4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9412 expref: 57 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582114.464444:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875464020893952:192.168.201.12@tcp:104: 00000100:00100000:1.0:1788582114.464533:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da791d9c0 going to sleep for 11 seconds 00010000:00010000:3.0:1788582114.467521:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9412 expref: 57 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.467557:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:3.0:1788582114.467562:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a7a02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.467571:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a7a02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.467597:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a7a02 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.467625:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582114.467832:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+57:2352:x1875464002035584:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 3457us (4920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582114.467842:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 81 00010000:00010000:1.0:1788582114.470287:0:5843:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.12@tcp) returned -22 from blocking AST (req@00000000765a6b1e x1875464020893952) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79f4 lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9412 expref: 56 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.470307:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a79f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9412 expref: 56 pid: 5845 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582114.470326:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc0700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875464020893952:192.168.201.12@tcp:104: 00010000:00010000:1.0:1788582114.470350:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:1.0:1788582114.470358:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a7a02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.470368:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a7a02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.470388:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a7a02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788582114.470781:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1788582114.470840:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed0bb9a5 reply state 0000000094cb65bf transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a7a02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582114.470849:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788582114.471062:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+57:11592:x1875464002035840:12345-192.168.201.12@tcp:36:bash.0 Request processed in 7541us (8039us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1788582114.471071:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 209 00000020:00080000:1.0:1788582114.471077:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788582114.473547:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a7a02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582114.473565:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a7a02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582114.473639:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a7a02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582114.473646:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fda00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582114.473651:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a7a02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582114.473669:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a7a02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582114.473688:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:0.0:1788582114.473692:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582114.473711:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a7a02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582114.473717:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fda00/0x2bc3aa892c3a7a02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582114.475024:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582114.475098:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002035968 00000100:00100000:3.0:1788582114.475111:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002035968 00000100:00100000:3.0:1788582114.475185:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 210 00000100:00100000:3.0:1788582114.475199:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+56:11592:x1875464002035968:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:3.0:1788582114.475260:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582114.475276:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7a09 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9419 expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.475374:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7a10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.475385:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.475394:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582114.475419:0:10136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788582114.475422:0:10136:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788582114.477238:0:10136:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.477288:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7a09 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9419 expref: 58 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.477327:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7a10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9419 expref: 57 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.477337:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:2.0:1788582114.477340:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788582114.477343:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27400, rc 0) 00000100:00100000:2.0:1788582114.477419:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+57:11592:x1875464002035968:12345-192.168.201.12@tcp:101:bash.0 Request processed in 2222us (2405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582114.477438:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 210 00000100:00100000:2.0:1788582114.485118:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582114.485234:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002036224 00000100:00100000:0.0:1788582114.485247:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002036224 00000100:00100000:1.0:1788582114.485450:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 59 00000100:00100000:1.0:1788582114.485462:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+57:11592:x1875464002036224:12345-192.168.201.12@tcp:35:bash.0 00000100:00100000:1.0:1788582114.485733:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+58:11592:x1875464002036224:12345-192.168.201.12@tcp:35:bash.0 Request processed in 268us (624us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1788582114.485742:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 59 00000100:00100000:0.0:1788582114.587345:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582114.587485:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002036352 00000100:00100000:3.0:1788582114.587496:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002036352 00000100:00100000:3.0:1788582114.587561:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 211 00000100:00100000:3.0:1788582114.587597:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+58:11598:x1875464002036352:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:3.0:1788582114.587623:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582114.587643:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7a17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9420 expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.587749:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7a1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.587765:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7a1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.587776:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7a1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582114.587811:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788582114.587814:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788582114.587831:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7a1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.587855:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7a17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9420 expref: 60 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.587871:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7a1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9420 expref: 59 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.587880:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:3.0:1788582114.587883:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788582114.587887:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26400, rc 0) 00000100:00100000:3.0:1788582114.587951:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+59:11598:x1875464002036352:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 357us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582114.587968:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 211 00000100:00100000:0.0:1788582114.592624:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582114.592726:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002036480 00000100:00100000:3.0:1788582114.592737:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002036480 00000100:00100000:3.0:1788582114.592816:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 212 00000100:00100000:3.0:1788582114.592828:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+59:11598:x1875464002036480:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:3.0:1788582114.592853:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582114.592878:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7a25 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9427 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.592952:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7a2c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.592968:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7a2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.592979:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7a2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.592995:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7a33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593002:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593018:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593322:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7a3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593349:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7a3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593356:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7a3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582114.593395:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788582114.593399:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788582114.593418:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7a3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593430:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7a3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593438:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7a2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593444:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7a2c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593452:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7a2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593457:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582114.593462:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7a2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593469:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7a2c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593481:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:3.0:1788582114.593484:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582114.593495:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7a2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593501:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7a2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593514:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7a33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593520:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7a33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593526:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7a33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593531:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582114.593534:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7a33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593539:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7a33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593546:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d0d917bdb00) 00010000:00010000:3.0:1788582114.593548:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582114.593551:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7a33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593556:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7a33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593588:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7a25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9427 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593614:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7a3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9427 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.593621:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:3.0:1788582114.593624:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788582114.593626:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26800, rc 0) 00000100:00100000:3.0:1788582114.593709:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+60:11598:x1875464002036480:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 883us (1096us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582114.593717:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 212 00000100:00100000:0.0:1788582114.610123:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582114.610254:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002036736 00000100:00100000:2.0:1788582114.610265:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002036736 00000100:00100000:2.0:1788582114.610336:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 213 00000100:00100000:2.0:1788582114.610348:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+60:11598:x1875464002036736:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:2.0:1788582114.610370:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582114.610392:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a7a41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c942e expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.610492:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7a48 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.610508:0:10136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7a10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9419 expref: 61 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.610516:0:10136:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7a3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9427 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.610541:0:10136:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7a48 lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.610577:0:10136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7a3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9427 expref: 61 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.610591:0:10136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7a3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9427 expref: 61 pid: 5843 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582114.610606:0:10136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c83085c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10136:1875464020894080:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582114.610711:0:10136:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7a10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9419 expref: 61 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.610720:0:10136:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7a10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9419 expref: 61 pid: 10136 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582114.610728:0:10136:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c83087100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10136:1875464020894208:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582114.610751:0:10136:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c837a5000 going to sleep for 11 seconds 00000100:00100000:3.0:1788582114.611363:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582114.611547:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002036864 00000100:00100000:1.0:1788582114.611554:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002036864 00010000:00010000:1.0:1788582114.611583:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7a3a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9427 expref: 62 pid: 5843 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582114.611618:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 82 00000100:00100000:1.0:1788582114.611627:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99087a3-3c83-4416-b2b9-d522b9885111+62:2351:x1875464002036864:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788582114.611641:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582114.611649:0:5830:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7a3a lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9427 expref: 62 pid: 5843 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.611685:0:5830:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7a3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9427 expref: 62 pid: 5843 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.611706:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:1.0:1788582114.611710:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7a48 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.611718:0:5830:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7a48 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.611724:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788582114.611768:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99087a3-3c83-4416-b2b9-d522b9885111+62:2351:x1875464002036864:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 142us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582114.611775:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 82 00010000:00010000:2.0:1788582114.615073:0:10136:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.201.12@tcp) returned -22 from blocking AST (req@00000000d54bf80b x1875464020894080) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7a3a lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9427 expref: 61 pid: 5843 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.615107:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26800/0x2bc3aa892c3a7a3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9427 expref: 61 pid: 5843 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582114.615130:0:10136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c83085c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10136:1875464020894080:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582114.615165:0:10136:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c83087100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:10136:1875464020894208:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582114.615191:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:2.0:1788582114.615198:0:10136:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7a48 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.615266:0:10136:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7a48 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.615275:0:10136:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7a48 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582114.618725:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582114.619119:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002036992 00000100:00100000:2.0:1788582114.619130:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002036992 00010000:00010000:2.0:1788582114.619176:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7a10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9419 expref: 61 pid: 10136 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582114.619249:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 83 00000100:00100000:2.0:1788582114.619260:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da7247050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+61:2349:x1875464002036992:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788582114.619275:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582114.619282:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7a10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9419 expref: 61 pid: 10136 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.619295:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7a10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9419 expref: 61 pid: 10136 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.619572:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7a10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9419 expref: 61 pid: 10136 timeout: 433 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.619608:0:7636:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:2.0:1788582114.619613:0:7636:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7a48 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.619623:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7a48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.619631:0:7636:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7a48 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582114.619831:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582114.619901:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da7247050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+60:2349:x1875464002036992:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 642us (1187us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582114.619910:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 83 00010000:00010000:1.0:1788582114.628836:0:10136:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7a48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.628855:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7a48 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582114.628883:0:10136:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788582114.630182:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a7a41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c942e expref: 61 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.630273:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7a48 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c942e expref: 60 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.630284:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:1.0:1788582114.630300:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788582114.630304:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04600, rc 0) 00000100:00100000:1.0:1788582114.630536:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+60:11598:x1875464002036736:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 20188us (20422us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1788582114.630545:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 213 00000100:00100000:0.0:1788582114.641785:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582114.641881:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002037248 00000100:00100000:1.0:1788582114.641893:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002037248 00000100:00100000:1.0:1788582114.641970:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 14 00000100:00100000:1.0:1788582114.641982:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99087a3-3c83-4416-b2b9-d522b9885111+60:11598:x1875464002037248:12345-192.168.201.12@tcp:103:lfs.0 00010000:00010000:1.0:1788582114.642002:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582114.642052:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd600/0x2bc3aa892c3a79a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9404 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.642073:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:1.0:1788582114.642078:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788582114.642136:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab21180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b99087a3-3c83-4416-b2b9-d522b9885111+59:11598:x1875464002037248:12345-192.168.201.12@tcp:103:lfs.0 Request processed in 156us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582114.642144:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 14 00000100:00100000:2.0:1788582114.646321:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582114.646393:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002037376 00000100:00100000:1.0:1788582114.646404:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002037376 00000100:00100000:1.0:1788582114.646467:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 214 00000100:00100000:1.0:1788582114.646491:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+59:11598:x1875464002037376:12345-192.168.201.12@tcp:58:lfs.0 00010000:00010000:1.0:1788582114.646610:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a7a56 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.646629:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a7a56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582114.646671:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a7a56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788582114.646919:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1788582114.647017:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83085f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+59:11598:x1875464002037376:12345-192.168.201.12@tcp:58:lfs.0 Request processed in 527us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582114.647026:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 214 00000100:00100000:0.0:1788582114.649558:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582114.649639:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002037504 00000100:00100000:3.0:1788582114.649647:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002037504 00000100:00100000:3.0:1788582114.649718:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 215 00000100:00100000:3.0:1788582114.649728:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+59:11598:x1875464002037504:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:3.0:1788582114.649748:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582114.649767:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7a5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9435 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.649820:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a7a56 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.649830:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7a5d lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9435 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.649850:0:5843:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a7a56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.649883:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7a5d lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9435 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.649896:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:3.0:1788582114.649899:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788582114.649902:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7a5d lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9435 expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582114.649909:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27800, rc 0) 00000100:00100000:3.0:1788582114.649970:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+60:11598:x1875464002037504:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 243us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582114.649978:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 215 00000100:00100000:0.0:1788582114.653326:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582114.653367:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582114.653398:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582114.653404:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002037632 00000100:00100000:3.0:1788582114.653414:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002037632 00000100:00100000:3.0:1788582114.653466:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 292 00000100:00100000:3.0:1788582114.653476:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2352:x1875464002037632:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582114.653540:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2352:x1875464002037632:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 65us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582114.653548:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 292 00000100:00100000:2.0:1788582114.653639:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002037760 00000100:00100000:2.0:1788582114.653644:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002037760 00000100:00100000:2.0:1788582114.653703:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 71 00000100:00100000:2.0:1788582114.653712:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+9:2352:x1875464002037760:12345-192.168.201.12@tcp:400:kworker.0 00000100:00080000:3.0:1788582114.653773:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788582114.654013:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002037888 00000100:00100000:1.0:1788582114.654018:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002037888 00000100:00100000:1.0:1788582114.654076:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 141 00000100:00100000:1.0:1788582114.654084:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2352:x1875464002037888:12345-192.168.201.12@tcp:400:kworker.0 00000100:00080000:3.0:1788582114.654143:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788582114.655823:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+9:2352:x1875464002037760:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 2102us (2413us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582114.655836:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 71 00000100:00100000:1.0:1788582114.655944:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2352:x1875464002037888:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 1860us (2575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582114.655953:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 141 00000040:00080000:0.0:1788582115.054170:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788582115.054181:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00010000:00010000:3.0:1788582115.054195:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788582115.054239:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788582115.054247:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788582115.054374:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbab23100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875464020894336:192.168.201.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788582115.054503:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8d8240 going to sleep for 11 seconds 00000100:00100000:0.0:1788582115.060086:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582115.060283:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002038016 00000100:00100000:2.0:1788582115.060295:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002038016 00000100:00080000:3.0:1788582115.060418:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788582115.060421:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 216 00000100:00100000:2.0:1788582115.060438:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+61:11599:x1875464002038016:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788582115.060514:0:10137:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788582115.060658:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+61:11599:x1875464002038016:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 Request processed in 216us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582115.060667:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 216 00000100:00100000:1.0:1788582115.060895:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbab23100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875464020894336:192.168.201.12@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788582115.075500:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582115.075604:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002038144 00000100:00100000:3.0:1788582115.075615:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002038144 00000100:00100000:3.0:1788582115.075692:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 217 00000100:00100000:3.0:1788582115.075730:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+60:11599:x1875464002038144:12345-192.168.201.12@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788582115.075805:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7a64 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.075823:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7a64 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.075835:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7a64 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.075851:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7a6b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.075869:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7a6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.075875:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7a6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.075903:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7a72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.075913:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7a72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.075919:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7a72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582115.075958:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788582115.075963:0:5845:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788582115.075975:0:5845:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7a72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.076005:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7a64 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.076012:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7a64 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.076018:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7a64 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.076023:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582115.076027:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7a64 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.076033:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7a64 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.076050:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d0d888de500) 00010000:00010000:3.0:1788582115.076053:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582115.076057:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7a64 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.076063:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7a64 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.076078:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7a6b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.076084:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7a6b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.076090:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7a6b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.076100:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582115.076103:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7a6b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.076109:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7a6b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.076116:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff8d0d917bdb00) 00010000:00010000:3.0:1788582115.076119:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582115.076121:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7a6b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.076127:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7a6b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.076142:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7a72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.076148:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7a72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.076154:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7a72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.076159:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582115.076162:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7a72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.076167:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7a72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.076183:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:3.0:1788582115.076185:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582115.076188:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7a72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.076193:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7a72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582115.076299:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83087100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+60:11599:x1875464002038144:12345-192.168.201.12@tcp:34:lhsmtool_posix.0 Request processed in 581us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582115.076306:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 217 00000100:00100000:3.0:1788582115.079403:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582115.079482:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002038400 00000100:00100000:0.0:1788582115.079491:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002038400 00000100:00100000:0.0:1788582115.079551:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 218 00000100:00100000:0.0:1788582115.079561:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+60:11599:x1875464002038400:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788582115.079600:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582115.079621:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7a79 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c943c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.079728:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7a80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.079740:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.079749:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582115.079757:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788582115.079833:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.079838:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7a80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.079842:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7a80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.079846:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089e00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582115.079849:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7a80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.079853:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7a80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.079872:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:0.0:1788582115.079879:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788582115.079883:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7a80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.079888:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089e00/0x2bc3aa892c3a7a80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.079921:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7a79 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c943c expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.079928:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d0d888de500) 00010000:00010000:0.0:1788582115.079929:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788582115.079932:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089800/0x2bc3aa892c3a7a79 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c943c expref: 62 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.079937:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7089800, rc 0) 00000100:00100000:0.0:1788582115.079983:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+61:11599:x1875464002038400:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 425us (593us total) trans 4294967503 rc 301/301 00000100:00100000:0.0:1788582115.079988:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 218 00000100:00100000:2.0:1788582115.083673:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582115.083761:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002038528 00000100:00100000:0.0:1788582115.083774:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002038528 00000100:00100000:0.0:1788582115.083839:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 219 00000100:00100000:0.0:1788582115.083851:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+61:11599:x1875464002038528:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788582115.083901:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788582115.084017:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83085c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+61:11599:x1875464002038528:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 Request processed in 167us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582115.084024:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 219 00000100:00100000:1.0:1788582115.089002:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582115.089262:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002038784 00000100:00100000:2.0:1788582115.089274:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002038784 00000100:00100000:2.0:1788582115.089335:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 220 00000100:00100000:2.0:1788582115.089345:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+61:11599:x1875464002038784:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788582115.089369:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582115.089372:0:10136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788582115.089401:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7a1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9420 expref: 61 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.089422:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:2.0:1788582115.089426:0:10136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788582115.089441:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7a8e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9443 expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788582115.089941:0:10136:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788582115.091427:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7a95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.091450:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7a95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.091463:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7a95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.091546:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7a8e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9443 expref: 63 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.091565:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7a95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9443 expref: 62 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.091575:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d0d85afcd00) 00010000:00010000:2.0:1788582115.091578:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788582115.091581:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05000, rc 0) 00000100:00100000:2.0:1788582115.091679:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+62:11599:x1875464002038784:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 2334us (2693us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1788582115.091689:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 220 00000100:00100000:2.0:1788582115.099536:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582115.099701:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002039040 00000100:00100000:1.0:1788582115.099712:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002039040 00000100:00100000:1.0:1788582115.099788:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 221 00000100:00100000:1.0:1788582115.099800:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+62:11599:x1875464002039040:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788582115.099875:0:10137:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582115.099901:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05000/0x2bc3aa892c3a7a95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9443 expref: 62 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.099920:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d0d85afcd00) 00010000:00010000:1.0:1788582115.099944:0:10137:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788582115.099968:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7aa3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.099982:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7aa3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.099992:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7aa3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.100006:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7aaa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x964e582e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.100013:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7aaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x964e582e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.100019:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7aaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x964e582e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.100385:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7aa3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.100395:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7aa3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.100401:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7aa3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.100408:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fc000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582115.100412:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7aa3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.100419:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7aa3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.100436:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:1.0:1788582115.100439:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582115.100442:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7aa3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.100449:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7aa3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.100458:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7aaa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x964e582e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.100464:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7aaa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x964e582e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.100470:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7aaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x964e582e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.100476:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582115.100478:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7aaa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x964e582e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.100484:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7aaa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x964e582e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.100491:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x964e582e (ffff8d0da2faf800) 00010000:00010000:1.0:1788582115.100493:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582115.100496:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7aaa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x964e582e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.100501:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7aaa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x964e582e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582115.101150:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83086680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+61:11599:x1875464002039040:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 Request processed in 1348us (1621us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788582115.101161:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 221 00000100:00100000:2.0:1788582115.116262:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582115.116381:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002039168 00000100:00100000:3.0:1788582115.116393:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002039168 00000100:00100000:3.0:1788582115.116488:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 222 00000100:00100000:3.0:1788582115.116500:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+61:11599:x1875464002039168:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788582115.116520:0:5845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582115.116543:0:5845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7ab1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c944a expref: -99 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.116579:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7ab8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.116593:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.116603:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.116753:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7ab1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c944a expref: 63 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.116773:0:5845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c944a expref: 62 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.116782:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d0d917bdb00) 00010000:00010000:3.0:1788582115.116784:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788582115.116787:0:5845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26200, rc 0) 00000100:00100000:3.0:1788582115.116851:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83084700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+62:11599:x1875464002039168:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 353us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582115.116866:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 222 00000100:00100000:2.0:1788582115.124984:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582115.125323:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002039424 00000100:00100000:1.0:1788582115.125334:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002039424 00000100:00100000:1.0:1788582115.125402:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 223 00000100:00100000:1.0:1788582115.125412:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+62:11599:x1875464002039424:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788582115.125550:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7abf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.125569:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7abf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.125583:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7abf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788582115.126317:0:10136:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1788582115.126329:0:10136:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 334120126155ns, next at 335120123323ns, rc = 0 00000004:00010000:1.0:1788582115.126417:0:10136:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a3155b7e reply state 00000000a3e27ca2 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7abf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582115.126426:0:10136:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788582115.126525:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83086a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+64:11599:x1875464002039424:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 Request processed in 1113us (1552us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788582115.126534:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 223 00010000:00010000:0.0:1788582115.129967:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7abf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.129998:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7abf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.130006:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7abf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.130012:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582115.130017:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7abf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.130025:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7abf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.130041:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d0d917bdb00) 00010000:00010000:0.0:1788582115.130044:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788582115.130048:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7abf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.130054:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd400/0x2bc3aa892c3a7abf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582115.132377:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582115.132615:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002039552 00000100:00100000:1.0:1788582115.132625:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002039552 00000100:00100000:1.0:1788582115.132698:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 224 00000100:00100000:1.0:1788582115.133156:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+63:11599:x1875464002039552:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788582115.133186:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582115.133329:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7ac6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9451 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.133399:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7ac6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9451 expref: 64 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.133414:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7ac6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9451 expref: 64 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.133434:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d0d917bdb00) 00010000:00010000:1.0:1788582115.133437:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788582115.133442:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fc000, rc 0) 00000100:00100000:1.0:1788582115.133510:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83085180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+64:11599:x1875464002039552:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 359us (1148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582115.133517:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 224 00000100:00100000:2.0:1788582115.138467:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582115.138606:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002039680 00000100:00100000:1.0:1788582115.138617:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002039680 00000100:00100000:1.0:1788582115.138686:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 63 00000100:00100000:1.0:1788582115.138696:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+9:2352:x1875464002039680:12345-192.168.201.12@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788582115.140027:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83085880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+10:2352:x1875464002039680:12345-192.168.201.12@tcp:2:lhsmtool_posix.0 Request processed in 1327us (1566us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788582115.140038:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 63 00000100:00100000:2.0:1788582115.151454:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582115.151640:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002039936 00000100:00100000:3.0:1788582115.151662:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002039936 00000100:00100000:3.0:1788582115.151998:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 60 00000100:00100000:3.0:1788582115.152012:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d91a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+64:11599:x1875464002039936:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788582115.152327:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d91a0a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+65:11599:x1875464002039936:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 Request processed in 317us (882us total) trans 4294967506 rc 0/0 00000100:00100000:3.0:1788582115.152336:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 60 00000100:00100000:2.0:1788582115.159501:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582115.159600:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002040192 00000100:00100000:3.0:1788582115.159610:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002040192 00000100:00100000:3.0:1788582115.159697:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 225 00000100:00100000:3.0:1788582115.159710:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+65:11599:x1875464002040192:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788582115.159883:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+65:11599:x1875464002040192:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 Request processed in 175us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582115.159904:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 225 00000100:00100000:0.0:1788582115.167336:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582115.169032:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002040320 00000100:00100000:1.0:1788582115.169049:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002040320 00000100:00100000:1.0:1788582115.169259:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 226 00000100:00100000:1.0:1788582115.169272:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+65:11599:x1875464002040320:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788582115.169296:0:10136:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582115.169319:0:10136:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a7acd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9458 expref: -99 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.169420:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a7ad4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.169436:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a7ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.169447:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a7ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582115.169497:0:10136:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788582115.169525:0:10136:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a7ad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.169553:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc200/0x2bc3aa892c3a7acd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9458 expref: 67 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.169573:0:10136:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a7ad4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9458 expref: 66 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.169582:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d0d917bdb00) 00010000:00010000:1.0:1788582115.169585:0:10136:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788582115.169589:0:10136:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fde00, rc 0) 00000100:00100000:1.0:1788582115.169669:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+66:11599:x1875464002040320:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 398us (2344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582115.169687:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 226 00000100:00100000:2.0:1788582115.172639:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582115.172744:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002040448 00000100:00100000:3.0:1788582115.172756:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002040448 00000100:00100000:3.0:1788582115.172813:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 64 00000100:00100000:3.0:1788582115.172823:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+10:2349:x1875464002040448:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788582115.172845:0:8034:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582115.172867:0:8034:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084a299f0/0x2bc3aa892c3a7adb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c945f expref: -99 pid: 8034 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788582115.172895:0:8034:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b98e2, blocks: 0x1 00010000:00010000:3.0:1788582115.172915:0:8034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=334s v=(0 0) 00010000:00010000:3.0:1788582115.172920:0:8034:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582115.172930:0:8034:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084a299f0/0x2bc3aa892c3a7adb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c945f expref: 11 pid: 8034 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.172948:0:8034:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000084a299f0/0x2bc3aa892c3a7adb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c945f expref: 11 pid: 8034 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.172964:0:8034:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26000, rc 0) 00000100:00100000:3.0:1788582115.173035:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+11:2349:x1875464002040448:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 213us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582115.173285:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 64 00000100:00100000:2.0:1788582115.179513:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582115.179981:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002040704 00000100:00100000:1.0:1788582115.179991:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002040704 00000100:00100000:1.0:1788582115.180039:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 227 00000100:00100000:1.0:1788582115.180146:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+66:11599:x1875464002040704:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788582115.180284:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+66:11599:x1875464002040704:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 Request processed in 141us (780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582115.185356:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 227 00000100:00100000:0.0:1788582115.187778:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582115.188234:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002040832 00000100:00100000:2.0:1788582115.188246:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002040832 00000100:00100000:2.0:1788582115.188345:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 65 00000100:00100000:2.0:1788582115.188354:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+11:11599:x1875464002040832:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788582115.188370:0:6693:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582115.188404:0:6693:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003a884617/0x2bc3aa892c3a7ae2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9466 expref: -99 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.188437:0:6693:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000084a299f0/0x2bc3aa892c3a7adb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c945f expref: 12 pid: 8034 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.188446:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788582115.188450:0:6693:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788582115.188455:0:6693:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a884617/0x2bc3aa892c3a7ae2 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9466 expref: 12 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.188491:0:6693:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000084a299f0/0x2bc3aa892c3a7adb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c945f expref: 12 pid: 8034 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.188506:0:6693:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000084a299f0/0x2bc3aa892c3a7adb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c945f expref: 12 pid: 8034 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582115.188520:0:6693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaeaad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1875464020894464:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582115.188662:0:6693:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c837a5480 going to sleep for 11 seconds 00000100:00100000:3.0:1788582115.191310:0:6693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaeaad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6693:1875464020894464:192.168.201.12@tcp:104: 00010000:00010000:3.0:1788582115.191341:0:6693:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003a884617/0x2bc3aa892c3a7ae2 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9466 expref: 12 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.191377:0:6693:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04a00, rc 0) 00000100:00100000:3.0:1788582115.191441:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+12:11599:x1875464002040832:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 3086us (3671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582115.191451:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 65 00000100:00100000:3.0:1788582115.192069:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582115.192142:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002040960 00000100:00100000:2.0:1788582115.192150:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002040960 00010000:00010000:2.0:1788582115.192182:0:7636:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000084a299f0/0x2bc3aa892c3a7adb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c945f expref: 12 pid: 8034 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582115.192245:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 84 00000100:00100000:2.0:1788582115.192255:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+12:2350:x1875464002040960:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788582115.192279:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582115.192302:0:7636:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000084a299f0/0x2bc3aa892c3a7adb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c945f expref: 12 pid: 8034 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.192316:0:7636:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000084a299f0/0x2bc3aa892c3a7adb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c945f expref: 12 pid: 8034 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.192335:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084a299f0/0x2bc3aa892c3a7adb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c945f expref: 12 pid: 8034 timeout: 434 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.192346:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788582115.192350:0:7636:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788582115.192355:0:7636:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003a884617/0x2bc3aa892c3a7ae2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9466 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.192362:0:7636:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003a884617/0x2bc3aa892c3a7ae2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9466 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.192392:0:7636:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000003a884617/0x2bc3aa892c3a7ae2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9466 expref: 11 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582115.192404:0:7636:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7636:1875464020894592:192.168.201.12@tcp:105: 00000100:00100000:2.0:1788582115.192474:0:7636:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c837a5180 going to sleep for 11 seconds 00000100:00100000:2.0:1788582115.194866:0:7636:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea8000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7636:1875464020894592:192.168.201.12@tcp:105: 00010000:00010000:2.0:1788582115.194890:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582115.194961:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b99087a3-3c83-4416-b2b9-d522b9885111+11:2350:x1875464002040960:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 2705us (2890us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582115.194972:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 84 00000100:00100000:0.0:1788582115.197031:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582115.197948:0:12171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002041088 00000100:00100000:1.0:1788582115.197966:0:12171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002041088 00002000:00100000:1.0:1788582115.198029:0:12171:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8d0dbf377800 x1875464002041088/t0(0) o4->b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp:716/0 lens 504/0 e 0 to 0 dl 1788582126 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788582115.198041:0:12171:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0dbf377800 with x1875464002041088 ext(0->12) 00002000:00010000:1.0:1788582115.198047:0:12171:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0dbf377800 00000100:00100000:1.0:1788582115.198184:0:12171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 7 00000100:00100000:1.0:1788582115.198194:0:12171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b99087a3-3c83-4416-b2b9-d522b9885111+11:2349:x1875464002041088:12345-192.168.201.12@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788582115.198750:0:12171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf377800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b99087a3-3c83-4416-b2b9-d522b9885111+13:2349:x1875464002041088:12345-192.168.201.12@tcp:4:lhsmtool_posix.0 Request processed in 556us (1727us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788582115.198759:0:12171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 7 00002000:00100000:1.0:1788582115.198767:0:12171:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_003: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff8d0dbf377800 x1875464002041088/t4294967321(0) o4->b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp:716/0 lens 504/448 e 0 to 0 dl 1788582126 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788582115.198775:0:12171:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0dbf377800 with x1875464002041088 ext(0->12) 00002000:00010000:1.0:1788582115.198778:0:12171:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0dbf377800 00000100:00100000:3.0:1788582115.205567:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582115.205661:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002041216 00000100:00100000:0.0:1788582115.205671:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002041216 00000100:00100000:0.0:1788582115.205731:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 228 00000100:00100000:0.0:1788582115.205743:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+66:11599:x1875464002041216:12345-192.168.201.12@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1788582115.273583:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000001:00080000:1.0:1788582115.273612:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967505 is committed 00000004:00080000:1.0:1788582115.273616:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:1.0:1788582115.273643:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1788582115.273670:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d0da791da80 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1788582115.273675:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d0da13e0700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d0d981bee40 00000020:00080000:1.0:1788582115.273678:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d0da13e0b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d0dac10a800 00000020:00080000:1.0:1788582115.273722:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:1.0:1788582115.273728:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1788582115.273744:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1788582115.273757:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d0dba8da000 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1788582115.273760:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d0c834a5500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d0d84c27540 00000020:00080000:1.0:1788582115.273762:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d0c834a5b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d0dbad3bc00 00000020:00080000:1.0:1788582115.273974:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:1.0:1788582115.274657:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1788582115.274682:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020894976:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788582115.274762:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582115.274834:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788582115.274842:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020894848:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788582115.274866:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582115.274907:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020894976 00000100:00100000:1.0:1788582115.274915:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020894976 00000100:00100000:1.0:1788582115.274966:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020894848 00000100:00100000:1.0:1788582115.274969:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020894848 00000100:00100000:1.0:1788582115.274992:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788582115.275001:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875464020894976:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788582115.275042:0:6691:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00000100:00100000:0.0:1788582115.275235:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020894720:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788582115.275271:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:1.0:1788582115.276183:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a9b98e1, atime: 0x6a9b98e1, ctime: 0x6a9b98e1, blocks: 0x1 00010000:00010000:1.0:1788582115.276195:0:6691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a7ae9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.276293:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=334s v=(0 0) 00010000:00010000:1.0:1788582115.276298:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582115.276305:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a7ae9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.276323:0:6691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a7ae9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.276334:0:6691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a7ae9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.276341:0:6691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a7ae9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582115.276703:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020894720 00000100:00100000:0.0:1788582115.276712:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020894720 00000100:00100000:0.0:1788582115.276749:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788582115.276757:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875464020894848:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788582115.276930:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788582115.276933:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788582114 00002000:00010000:0.0:1788582115.276935:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788582115.276937:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788582114 -> 1788582114 00002000:00010000:0.0:1788582115.276939:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788582115.277025:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3309:x1875464020894848:12345-0@lo:2:osp-syn-1-0.0 Request processed in 259us (2148us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1788582115.277040:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788582115.277059:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788582115.277067:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1875464020894720:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788582115.277093:0:6692:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1788582115.277107:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7af0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.277122:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009c48b440/0x2bc3aa892c3a78ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93c5 expref: 12 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.277130:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788582115.277134:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788582115.277138:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7af0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.277188:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009c48b440/0x2bc3aa892c3a78ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93c5 expref: 12 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.277241:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009c48b440/0x2bc3aa892c3a78ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93c5 expref: 12 pid: 6692 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582115.277255:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf376a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1875464020895104:192.168.201.12@tcp:104: 00000100:00100000:0.0:1788582115.277327:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8d86c0 going to sleep for 11 seconds 00010000:00010000:1.0:1788582115.277603:0:6691:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788582115.279059:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1875464020894976:12345-0@lo:6:osp-syn-0-0.0 Request processed in 4051us (4289us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788582115.279072:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788582115.279785:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:1.0:1788582115.279792:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:1.0:1788582115.279814:0:3309:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8d0dbbdc0000 x1875464020894848/t4294967322(4294967322) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788582131 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:1.0:1788582115.279826:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d0dbbdc0000/2, rc 0, transno 4294967322 00000100:00100000:1.0:1788582115.279845:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020894848:0@lo:2:osp-syn-1-0.0 00000004:00080000:1.0:1788582115.279859:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d0dbbdc1500/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788582115.279863:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020894976:0@lo:6:osp-syn-0-0.0 00000100:00080000:3.0:1788582115.280417:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788582115.280423:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788582115.280737:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc58000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+20:11599:x1875464002041216:12345-192.168.201.12@tcp:44:lhsmtool_posix.0 Request processed in 74989us (75171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582115.280749:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 228 00000100:00100000:0.0:1788582115.289825:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf376a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1875464020895104:192.168.201.12@tcp:104: 00010000:00010000:0.0:1788582115.289866:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7af0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582115.290004:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00010000:00010000:2.0:1788582115.292080:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582115.292095:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a7ae9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.292110:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fc200 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582115.292116:0:7637:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a7ae9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.292129:0:7637:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a7ae9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.292155:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a7ae9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.292164:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000089f58087/0x2bc3aa892c3a7ae9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.292197:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582115.292199:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582115.292224:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582115.294511:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582115.295090:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002041472 00000100:00100000:2.0:1788582115.295102:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002041472 00000100:00100000:2.0:1788582115.295171:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 69 00000100:00100000:2.0:1788582115.295183:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+13:2350:x1875464002041472:12345-192.168.201.12@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788582115.295868:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002041344 00000100:00100000:1.0:1788582115.295876:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002041344 00010000:00010000:2.0:1788582115.304316:0:5830:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009c48b440/0x2bc3aa892c3a78ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93c5 expref: 14 pid: 6692 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582115.304958:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 85 00000100:00100000:0.0:1788582115.304973:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+14:2350:x1875464002041344:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788582115.304991:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582115.304999:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009c48b440/0x2bc3aa892c3a78ab lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93c5 expref: 14 pid: 6692 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.305015:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009c48b440/0x2bc3aa892c3a78ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93c5 expref: 14 pid: 6692 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.305039:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c48b440/0x2bc3aa892c3a78ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93c5 expref: 14 pid: 6692 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.305066:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788582115.305071:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788582115.305077:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7af0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.305087:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7af0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.305114:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788582115.305176:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc7b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+13:2350:x1875464002041344:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 207us (15172us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582115.305185:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 85 00010000:00010000:0.0:1788582115.305349:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7af0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.305360:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7af0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.308319:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7af0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.308345:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7af0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.309604:0:6692:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788582115.311104:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582115.311116:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7af0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.311128:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089c00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582115.311134:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7af0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.311145:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7af0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.311171:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7af0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.311178:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7af0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.311199:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582115.311222:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582115.311225:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582115.312528:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf374e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1875464020894720:12345-0@lo:6:osp-syn-1-0.0 Request processed in 35456us (37249us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788582115.312542:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:2.0:1788582115.312704:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d0dbbdc2d80/2, rc 0, transno 4294967323 00000100:00100000:2.0:1788582115.312713:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020894720:0@lo:6:osp-syn-1-0.0 00000001:00080000:0.0:1788582115.345584:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1788582115.345607:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:1.0:1788582115.345965:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+7:2350:x1875464002041472:12345-192.168.201.12@tcp:16:lhsmtool_posix.0 Request processed in 50778us (51459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582115.345977:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 69 00000100:00100000:0.0:1788582115.351286:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582115.351395:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002041728 00000100:00100000:1.0:1788582115.351407:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002041728 00000100:00100000:1.0:1788582115.351485:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 229 00000100:00100000:1.0:1788582115.351496:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+20:11599:x1875464002041728:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788582115.351554:0:10136:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582115.351582:0:10136:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fde00/0x2bc3aa892c3a7ad4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9458 expref: 20 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.351600:0:10136:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d0d917bdb00) 00010000:00010000:1.0:1788582115.351605:0:10136:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788582115.351635:0:10136:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a7af7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.351661:0:10136:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a7af7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.351672:0:10136:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a7af7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788582115.351970:0:10136:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3f94239 reply state 00000000f0b1df34 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a7af7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582115.351993:0:10136:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788582115.352119:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b99087a3-3c83-4416-b2b9-d522b9885111+21:11599:x1875464002041728:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 Request processed in 623us (842us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788582115.352126:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 229 00010000:00010000:0.0:1788582115.356491:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a7af7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.356510:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a7af7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.356518:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a7af7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.356523:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582115.356528:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a7af7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.356535:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a7af7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.356553:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d0d917bdb00) 00010000:00010000:0.0:1788582115.356556:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582115.356560:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a7af7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.356567:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fd200/0x2bc3aa892c3a7af7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10136 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582115.360929:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582115.361488:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002041856 00000100:00100000:3.0:1788582115.361499:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002041856 00000100:00100000:3.0:1788582115.361562:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 70 00000100:00100000:3.0:1788582115.361574:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+7:2350:x1875464002041856:12345-192.168.201.12@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788582115.361812:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788582115.361817:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1788582114 -> 1788582114 00002000:00010000:3.0:1788582115.361820:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788582113 00002000:00010000:3.0:1788582115.361822:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1788582114 -> 1788582114 00002000:00010000:3.0:1788582115.361824:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788582115.361889:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf375180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+8:2350:x1875464002041856:12345-192.168.201.12@tcp:2:lhsmtool_posix.0 Request processed in 316us (970us total) trans 4294967324 rc 0/0 00000100:00100000:3.0:1788582115.361897:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 70 00000100:00100000:2.0:1788582115.373311:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582115.374249:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002042112 00000100:00100000:1.0:1788582115.374261:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002042112 00000100:00100000:1.0:1788582115.374333:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 230 00000100:00100000:1.0:1788582115.374344:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+20:11599:x1875464002042112:12345-192.168.201.12@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1788582115.374432:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a7afe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.374451:0:10137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7ab8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c944a expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.374624:0:10137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a7afe lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.374682:0:10137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c944a expref: 20 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.374696:0:10137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c944a expref: 20 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582115.374711:0:10137:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc2680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10137:1875464020895232:192.168.201.12@tcp:104: 00000100:00100000:1.0:1788582115.374841:0:10137:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8721c6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788582115.378962:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582115.379128:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002042240 00000100:00100000:3.0:1788582115.379138:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002042240 00010000:00010000:3.0:1788582115.379176:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7ab8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c944a expref: 21 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582115.379254:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 86 00000100:00100000:3.0:1788582115.379264:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+21:2350:x1875464002042240:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582115.379281:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582115.379288:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7ab8 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c944a expref: 21 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.379301:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c944a expref: 21 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.379324:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d0d917bdb00) 00010000:00010000:3.0:1788582115.379329:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a7afe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.379339:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a7afe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.379346:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a7afe lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.379383:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582115.379435:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+21:2350:x1875464002042240:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 172us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582115.379442:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 86 00010000:00010000:2.0:1788582115.379798:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7ab8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c944a expref: 20 pid: 5845 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582115.379815:0:10137:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc2680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10137:1875464020895232:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582115.379843:0:10137:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a7afe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.379850:0:10137:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a7afe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.379856:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a7afe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.379886:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a7afe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.379892:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a7afe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.379898:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a7afe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.379904:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fcc00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582115.379908:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a7afe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.379915:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a7afe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.379924:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d0d917bdb00) 00010000:00010000:2.0:1788582115.379926:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788582115.379938:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a7afe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.379944:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fcc00/0x2bc3aa892c3a7afe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582115.379984:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+19:11599:x1875464002042112:12345-192.168.201.12@tcp:55:lhsmtool_posix.0 Request processed in 5642us (6686us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788582115.379992:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 230 00000100:00100000:2.0:1788582115.387619:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582115.390736:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002042368 00000100:00100000:0.0:1788582115.390777:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002042368 00000100:00100000:2.0:1788582115.392789:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 71 00000100:00100000:2.0:1788582115.392804:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+8:2349:x1875464002042368:12345-192.168.201.12@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788582115.392863:0:6692:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003ca75193/0x2bc3aa892c3a7b05 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.392892:0:6692:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003a884617/0x2bc3aa892c3a7ae2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9466 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.392901:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788582115.392906:0:6692:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788582115.392910:0:6692:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ca75193/0x2bc3aa892c3a7b05 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.392949:0:6692:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003a884617/0x2bc3aa892c3a7ae2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9466 expref: 8 pid: 6693 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.392965:0:6692:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003a884617/0x2bc3aa892c3a7ae2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9466 expref: 8 pid: 6693 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582115.393017:0:6692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1875464020895360:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582115.393135:0:6692:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c837a53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788582115.396744:0:6692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6692:1875464020895360:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582115.396776:0:6692:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003ca75193/0x2bc3aa892c3a7b05 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582115.400764:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582115.400978:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002042496 00000100:00100000:0.0:1788582115.400995:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002042496 00010000:00010000:0.0:1788582115.401047:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003a884617/0x2bc3aa892c3a7ae2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9466 expref: 9 pid: 6693 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582115.401089:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 87 00000100:00100000:0.0:1788582115.401099:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+9:2349:x1875464002042496:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788582115.401114:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582115.401135:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003a884617/0x2bc3aa892c3a7ae2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9466 expref: 9 pid: 6693 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.401149:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003a884617/0x2bc3aa892c3a7ae2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9466 expref: 9 pid: 6693 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.401174:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003a884617/0x2bc3aa892c3a7ae2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9466 expref: 9 pid: 6693 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.401192:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788582115.401196:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788582115.401261:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003ca75193/0x2bc3aa892c3a7b05 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.401272:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003ca75193/0x2bc3aa892c3a7b05 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.401298:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788582115.401362:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+8:2349:x1875464002042496:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 264us (609us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582115.401370:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 87 00010000:00010000:1.0:1788582115.401624:0:6692:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003ca75193/0x2bc3aa892c3a7b05 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.401635:0:6692:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003ca75193/0x2bc3aa892c3a7b05 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.401669:0:6692:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003ca75193/0x2bc3aa892c3a7b05 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.401677:0:6692:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003ca75193/0x2bc3aa892c3a7b05 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.401686:0:6692:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003ca75193/0x2bc3aa892c3a7b05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.401692:0:6692:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04e00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582115.401697:0:6692:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003ca75193/0x2bc3aa892c3a7b05 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.401705:0:6692:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003ca75193/0x2bc3aa892c3a7b05 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.401716:0:6692:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003ca75193/0x2bc3aa892c3a7b05 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.401724:0:6692:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003ca75193/0x2bc3aa892c3a7b05 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6692 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582115.401781:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b99087a3-3c83-4416-b2b9-d522b9885111+7:2349:x1875464002042368:12345-192.168.201.12@tcp:1:lhsmtool_posix.0 Request processed in 8981us (14173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582115.401790:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 71 00000100:00100000:0.0:1788582115.421428:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582115.421747:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002042752 00000100:00100000:3.0:1788582115.421770:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002042752 00000100:00100000:3.0:1788582115.421829:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 231 00000100:00100000:3.0:1788582115.421840:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+19:11599:x1875464002042752:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788582115.421926:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7b0c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.421942:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7b0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.421953:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7b0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.423698:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7b13 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.423718:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7ac6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9451 expref: 20 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.423727:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7b13 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.423766:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7ac6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9451 expref: 20 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.423783:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7ac6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9451 expref: 20 pid: 10137 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582115.423799:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dabc79880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875464020895488:192.168.201.12@tcp:104: 00000100:00100000:3.0:1788582115.423961:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d84cfd180 going to sleep for 11 seconds 00000100:00100000:1.0:1788582115.437357:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582115.437657:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002042880 00000100:00100000:2.0:1788582115.437669:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002042880 00010000:00010000:2.0:1788582115.437715:0:5829:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7ac6 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9451 expref: 21 pid: 10137 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582115.437758:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 88 00000100:00100000:2.0:1788582115.437770:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+21:2350:x1875464002042880:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788582115.437785:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582115.437792:0:5829:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7ac6 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9451 expref: 21 pid: 10137 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.437806:0:5829:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7ac6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9451 expref: 21 pid: 10137 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.437831:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d0d917bdb00) 00010000:00010000:2.0:1788582115.437836:0:5829:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7b13 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.437865:0:5829:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7b13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.437873:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7b13 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.437895:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582115.437960:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+21:2350:x1875464002042880:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 192us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582115.437968:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 88 00010000:00010000:3.0:1788582115.438344:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc000/0x2bc3aa892c3a7ac6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9451 expref: 20 pid: 10137 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582115.438561:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dabc79880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875464020895488:192.168.201.12@tcp:104: 00010000:00010000:3.0:1788582115.438584:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7b13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.438595:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7b13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.438601:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7b13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788582115.438822:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:0.0:1788582115.444163:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1788582115.444335:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1788582115.444620:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1875464020895616:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788582115.444705:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582115.444738:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d84ec8480 going to sleep for 11 seconds 00000100:00100000:2.0:1788582115.444927:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020895616 00000100:00100000:2.0:1788582115.444936:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020895616 00000100:00100000:2.0:1788582115.445009:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788582115.445019:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1875464020895616:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788582115.445124:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1875464020895616:12345-0@lo:1000:mdt00_000.0 Request processed in 106us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582115.445132:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788582115.445411:0:5843:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:0.0:1788582115.445418:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d0dbbdc0000, transno 4294967322 00000100:00100000:0.0:1788582115.445432:0:5843:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff8d0dbbdc2d80 x1875464020894720/t4294967323(4294967323) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788582131 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788582115.445444:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1875464020895616:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1788582115.446281:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1788582115.446362:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1875464020895744:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788582115.446985:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582115.447138:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da791dd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788582115.447196:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020895744 00000100:00100000:2.0:1788582115.447264:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020895744 00000100:00100000:2.0:1788582115.447353:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788582115.447364:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1875464020895744:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788582115.447581:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5843:x1875464020895744:12345-0@lo:1000:mdt00_000.0 Request processed in 218us (595us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1788582115.447588:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788582115.447687:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5843:1875464020895744:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788582115.447728:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7b13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.447740:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7b13 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.447749:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7b13 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.447770:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582115.447776:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7b13 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.447785:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7b13 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.447805:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d0d917bdb00) 00010000:00010000:0.0:1788582115.447809:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788582115.447814:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7b13 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.447821:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27200/0x2bc3aa892c3a7b13 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.447858:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a7a56 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.447864:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a7a56 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.447870:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a7a56 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.447875:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fc800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582115.447879:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a7a56 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.447885:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a7a56 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.447903:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:0.0:1788582115.447905:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788582115.447912:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7a5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9435 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.447925:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7a5d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9435 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.447933:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7a5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9435 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.447962:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7a5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9435 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582115.447976:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf377100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875464020895872:192.168.201.12@tcp:105: 00000100:00100000:0.0:1788582115.448069:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da791dd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788582115.454817:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582115.454943:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf377100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5843:1875464020895872:192.168.201.12@tcp:105: 00010000:00010000:0.0:1788582115.454975:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a7a56 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.454987:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc800/0x2bc3aa892c3a7a56 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.455042:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7b1a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.455058:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7b1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.455088:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7b1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.455100:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7b1a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.455106:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7b1a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.455112:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7b1a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.455118:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582115.455122:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7b1a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.455129:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7b1a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.455141:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:0.0:1788582115.455144:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582115.455147:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7b1a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.455153:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7b1a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.455163:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7b0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.455169:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7b0c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.455180:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7b0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.455186:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582115.455189:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7b0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.455196:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7b0c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.455254:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:0.0:1788582115.455257:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788582115.455261:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7b0c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582115.455267:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26c00/0x2bc3aa892c3a7b0c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582115.455704:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+23:11599:x1875464002042752:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 Request processed in 33863us (34283us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1788582115.455716:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 231 00000020:00080000:0.0:1788582115.455722:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788582115.456170:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788582115.456177:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788582115.456883:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788582115.456893:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788582115.457414:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002043008 00000100:00100000:3.0:1788582115.457424:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002043008 00000100:00100000:3.0:1788582115.457619:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 61 00000100:00100000:3.0:1788582115.457630:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+23:11598:x1875464002043008:12345-192.168.201.12@tcp:49:lfs.0 00000100:00100000:3.0:1788582115.457779:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+23:11598:x1875464002043008:12345-192.168.201.12@tcp:49:lfs.0 Request processed in 151us (2973us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582115.457787:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 61 00000100:00100000:1.0:1788582115.465496:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582115.465766:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002043264 00000100:00100000:3.0:1788582115.465780:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002043264 00000100:00100000:3.0:1788582115.465849:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 232 00000100:00100000:3.0:1788582115.465860:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+23:11598:x1875464002043264:12345-192.168.201.12@tcp:58:lfs.0 00000040:00080000:3.0:1788582115.466701:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788582115.466914:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b99087a3-3c83-4416-b2b9-d522b9885111+23:11598:x1875464002043264:12345-192.168.201.12@tcp:58:lfs.0 Request processed in 1053us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582115.466925:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 232 00000100:00100000:1.0:1788582115.471016:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582115.474621:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002043520 00000100:00100000:3.0:1788582115.474639:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002043520 00000100:00100000:3.0:1788582115.474739:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 62 00000100:00100000:3.0:1788582115.474751:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d84ecd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+23:11599:x1875464002043520:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788582115.475813:0:10138:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788582115.475902:0:10138:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1788582115.475943:0:10138:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7b21 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.475959:0:10138:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7b21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.475971:0:10138:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7b21 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.475980:0:10138:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7b21 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.478546:0:10138:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7b21 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.478556:0:10138:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7b21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.478622:0:10138:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788582115.478771:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d84ecd450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+25:11599:x1875464002043520:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 Request processed in 4017us (7761us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1788582115.478781:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 62 00000020:00080000:3.0:1788582115.478787:0:10138:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788582115.486239:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788582115.486257:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7b21 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.486269:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26200 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582115.486274:0:5832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7b21 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.486285:0:5832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7b21 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.486305:0:5832:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff8d0d917bd200) 00010000:00010000:1.0:1788582115.486308:0:5832:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788582115.486313:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7b21 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.486320:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26200/0x2bc3aa892c3a7b21 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 10138 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.486379:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582115.486382:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582115.486384:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582115.520294:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582115.520410:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002043648 00000100:00100000:2.0:1788582115.520421:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002043648 00000100:00100000:2.0:1788582115.520488:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 233 00000100:00100000:2.0:1788582115.520514:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+25:11601:x1875464002043648:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:2.0:1788582115.520543:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582115.520564:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7b28 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c946d expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.520634:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7b2f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.520672:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7b2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.520686:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7b2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.520702:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a7b36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.520709:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a7b36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.520716:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a7b36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.520985:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7b3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.520995:0:10137:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7a48 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c942e expref: 26 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.521004:0:10137:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7b3d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.521575:0:10137:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7a48 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c942e expref: 26 pid: 10136 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582115.521591:0:10137:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7a48 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c942e expref: 26 pid: 10136 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582115.521606:0:10137:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaeab100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10137:1875464020896000:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582115.523063:0:10137:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c837a53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788582115.526911:0:10137:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaeab100 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:10137:1875464020896000:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582115.526944:0:10137:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7b3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582115.528318:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582115.528686:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002043904 00000100:00100000:3.0:1788582115.528697:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002043904 00000100:00100000:3.0:1788582115.528779:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 63 00000100:00100000:3.0:1788582115.528791:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+27:5586:x1875464002043904:12345-192.168.201.12@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788582115.529060:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+28:5586:x1875464002043904:12345-192.168.201.12@tcp:35:ldlm_bl.0 Request processed in 270us (747us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1788582115.529070:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 63 00000100:00100000:0.0:1788582115.532427:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582115.532618:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002044032 00000100:00100000:3.0:1788582115.532633:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002044032 00010000:00010000:3.0:1788582115.532695:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7a48 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c942e expref: 28 pid: 10136 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582115.532740:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 89 00000100:00100000:3.0:1788582115.532751:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da7246c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+28:2349:x1875464002044032:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582115.532767:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582115.532774:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7a48 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c942e expref: 28 pid: 10136 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.532789:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7a48 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c942e expref: 28 pid: 10136 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.532814:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a7a48 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c942e expref: 28 pid: 10136 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.532831:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:3.0:1788582115.532836:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7b3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.532846:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.532870:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7b3d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582115.532908:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582115.532971:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da7246c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b99087a3-3c83-4416-b2b9-d522b9885111+27:2349:x1875464002044032:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 221us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582115.532979:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 89 00010000:00010000:1.0:1788582115.534799:0:10137:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.534814:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582115.534863:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788582115.534868:0:10137:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788582115.534887:0:10137:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.534904:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.534914:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7b2f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.534921:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7b2f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.534929:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7b2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.534935:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582115.534939:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7b2f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.534966:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7b2f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.534981:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:1.0:1788582115.534984:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582115.535000:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7b2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.535006:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05800/0x2bc3aa892c3a7b2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.535021:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a7b36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.535026:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a7b36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.535042:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a7b36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.535048:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05e00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582115.535051:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a7b36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.535057:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a7b36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.535065:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff8d0d85afcb00) 00010000:00010000:1.0:1788582115.535068:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582115.535071:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a7b36 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.535086:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a7b36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.535129:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7b28 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c946d expref: 27 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.535144:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c946d expref: 26 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582115.535152:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:1.0:1788582115.535154:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788582115.535157:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05200, rc 0) 00000100:00100000:1.0:1788582115.535261:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+26:11601:x1875464002043648:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 14747us (14976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582115.535270:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 233 00010000:00010000:0.0:1788582116.084373:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788582116.461876:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788582116.461887:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788582116.461932:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788582116.461945:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788582116.462092:0:11685:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875464020896128:192.168.201.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788582116.462198:0:11685:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85856e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788582116.469577:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582116.470012:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002044160 00000100:00100000:3.0:1788582116.470022:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002044160 00000100:00100000:3.0:1788582116.470083:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 234 00000100:00100000:3.0:1788582116.470094:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+27:11613:x1875464002044160:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788582116.470144:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788582116.470268:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf377100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+27:11613:x1875464002044160:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 Request processed in 176us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582116.470276:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 234 00000100:00100000:3.0:1788582116.474771:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582116.474902:0:11685:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc3480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11685:1875464020896128:192.168.201.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788582116.483330:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002044416 00000100:00100000:0.0:1788582116.483350:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002044416 00000100:00100000:0.0:1788582116.483423:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 235 00000100:00100000:0.0:1788582116.483433:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+26:11613:x1875464002044416:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788582116.483464:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582116.483487:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7b44 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9474 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582116.483596:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7b4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582116.483611:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582116.483623:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7b4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582116.483646:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788582116.483788:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088000/0x2bc3aa892c3a7b44 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9474 expref: 29 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582116.483803:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7b4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9474 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582116.483812:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:0.0:1788582116.483815:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788582116.483820:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7088600, rc 0) 00000100:00100000:0.0:1788582116.483895:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+28:11613:x1875464002044416:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 463us (9135us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1788582116.483902:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 235 00000040:00080000:1.0:1788582116.493781:0:12564:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788582116.493793:0:12564:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788582116.494186:0:12564:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788582116.494193:0:12564:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788582116.497875:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582116.498469:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002044544 00000100:00100000:3.0:1788582116.498481:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002044544 00000100:00100000:3.0:1788582116.498543:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 15 00000100:00100000:3.0:1788582116.498554:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaeab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+28:2350:x1875464002044544:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582116.498567:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582116.498591:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088600/0x2bc3aa892c3a7b4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9474 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582116.498610:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:3.0:1788582116.498615:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582116.498703:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaeab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b99087a3-3c83-4416-b2b9-d522b9885111+27:2350:x1875464002044544:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 149us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582116.498760:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582116.498840:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002044800 00000100:00100000:2.0:1788582116.498845:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002044800 00000100:00100000:2.0:1788582116.499419:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 236 00000100:00100000:2.0:1788582116.499429:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+28:11613:x1875464002044800:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788582116.499508:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7b59 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582116.499523:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7b59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582116.499535:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7b59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582116.499862:0:10137:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7b59 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582116.499870:0:10137:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7b59 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582116.499878:0:10137:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7b59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582116.499884:0:10137:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04a00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582116.499889:0:10137:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7b59 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582116.499897:0:10137:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7b59 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582116.499909:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:2.0:1788582116.499912:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788582116.499917:0:10137:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7b59 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582116.499923:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7b59 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582116.500060:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+29:11613:x1875464002044800:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 Request processed in 633us (1300us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1788582116.500069:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 236 00000040:00080000:2.0:1788582116.500395:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788582116.500400:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1788582116.500441:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 15 00000040:00080000:2.0:1788582116.500991:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788582116.501005:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788582116.519517:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582116.519597:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002045056 00000100:00100000:1.0:1788582116.519607:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002045056 00000100:00100000:1.0:1788582116.519685:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 64 00000100:00100000:1.0:1788582116.519696:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaeab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+28:11613:x1875464002045056:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788582116.519947:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaeab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+29:11613:x1875464002045056:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 Request processed in 252us (440us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788582116.519956:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 64 00000100:00100000:2.0:1788582116.845711:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788582116.845738:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020896256:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788582116.845813:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582116.846233:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020896256 00000100:00100000:0.0:1788582116.846243:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020896256 00000100:00100000:0.0:1788582116.846295:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788582116.846317:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875464020896256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788582116.846349:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3855613952 00000100:00100000:0.0:1788582116.846399:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875464020896256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582116.846506:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788582116.848080:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020896256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788582116.849055:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020896512:0@lo:400:kworker.0 00000100:00100000:1.0:1788582116.849118:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582116.849226:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020896384:0@lo:400:kworker.0 00000100:00100000:2.0:1788582116.849266:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582116.849316:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020896384 00000100:00100000:2.0:1788582116.849324:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020896384 00000100:00100000:2.0:1788582116.849373:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788582116.849382:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3307:x1875464020896384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582116.849441:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3307:x1875464020896384:12345-0@lo:400:kworker.0 Request processed in 58us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582116.849447:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:2.0:1788582116.849488:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3307:1875464020896384:0@lo:400:kworker.0 00000100:00100000:1.0:1788582116.856172:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788582116.856241:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020896640:0@lo:400:kworker.0 00000100:00100000:1.0:1788582116.856651:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582116.859004:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020896768:0@lo:400:kworker.0 00000100:00100000:2.0:1788582116.859070:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582116.859120:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788582116.859127:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020896896:0@lo:400:kworker.0 00000100:00100000:2.0:1788582116.859151:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582116.859554:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020896768 00000100:00100000:1.0:1788582116.859563:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020896768 00000100:00100000:1.0:1788582116.859630:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788582116.859643:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaeaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1875464020896768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582116.859698:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaeaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1875464020896768:12345-0@lo:400:kworker.0 Request processed in 58us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582116.859705:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788582116.866857:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020896768:0@lo:400:kworker.0 00000100:00100000:3.0:1788582116.869880:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020896512 00000100:00100000:3.0:1788582116.869897:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020896512 00000100:00100000:3.0:1788582116.869987:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020896640 00000100:00100000:3.0:1788582116.869991:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020896640 00000100:00100000:3.0:1788582116.870037:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020896896 00000100:00100000:3.0:1788582116.870040:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020896896 00000100:00100000:3.0:1788582116.870064:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788582116.870074:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020896512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582116.870148:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788582116.870173:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020896640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582116.870346:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020896640:12345-0@lo:400:kworker.0 Request processed in 189us (13694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582116.870389:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1788582116.871042:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788582116.871051:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020896896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582116.872605:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020896512:12345-0@lo:400:kworker.0 Request processed in 2526us (23480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582116.872627:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:3.0:1788582116.872655:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788582116.873650:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020896640:0@lo:400:kworker.0 00000100:00100000:3.0:1788582116.873668:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020896512:0@lo:400:kworker.0 00000100:00100000:2.0:1788582116.874283:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020896896:12345-0@lo:400:kworker.0 Request processed in 3230us (15127us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582116.874295:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788582116.874309:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020896896:0@lo:400:kworker.0 00010000:00010000:2.0:1788582117.105024:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582118.130762:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788582118.368311:0:12615:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788582118.368322:0:12615:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788582118.368370:0:12615:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788582118.368376:0:12615:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788582118.381453:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788582118.381477:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020897024:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788582118.381563:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582118.381675:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020897024 00000100:00100000:2.0:1788582118.381684:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020897024 00000100:00100000:2.0:1788582118.381747:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788582118.381758:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875464020897024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788582118.381793:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788582118.381843:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875464020897024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582118.381851:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788582118.381914:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020897024:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788582118.382125:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788582118.577921:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582118.577959:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002045312 00000100:00100000:3.0:1788582118.577969:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002045312 00000100:00100000:3.0:1788582118.578034:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 237 00000100:00100000:3.0:1788582118.578044:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+29:11634:x1875464002045312:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:3.0:1788582118.578071:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582118.578095:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7b60 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c947b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582118.578254:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7b67 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582118.578270:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7b67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582118.578281:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7b67 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582118.578292:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788582118.578418:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7b60 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c947b expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582118.578436:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7b67 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c947b expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582118.578445:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:3.0:1788582118.578448:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788582118.578451:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26400, rc 0) 00000100:00100000:3.0:1788582118.578524:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+31:11634:x1875464002045312:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 480us (613us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1788582118.578531:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 237 00000100:00080000:3.0:1788582118.578567:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788582118.584352:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582118.585153:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002045440 00000100:00100000:2.0:1788582118.585165:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002045440 00000100:00100000:2.0:1788582118.585355:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 238 00000100:00100000:2.0:1788582118.585366:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dabc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+31:11634:x1875464002045440:12345-192.168.201.12@tcp:54:lfs.0 00010000:00010000:2.0:1788582118.585440:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a7b75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582118.585459:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a7b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582118.585485:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a7b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582118.585514:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a7b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582118.585521:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a7b75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582118.585529:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a7b75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582118.585534:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05e00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582118.585539:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a7b75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582118.585661:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a7b75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582118.585677:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:2.0:1788582118.585680:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788582118.585686:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a7b75 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582118.585693:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a7b75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582118.585773:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dabc7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+31:11634:x1875464002045440:12345-192.168.201.12@tcp:54:lfs.0 Request processed in 408us (1431us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582118.585781:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 238 00000100:00100000:3.0:1788582118.662881:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582118.667251:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002045568 00000100:00100000:1.0:1788582118.667271:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002045568 00000100:00100000:2.0:1788582118.667515:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 72 00000100:00100000:2.0:1788582118.667541:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+7:2352:x1875464002045568:12345-192.168.201.12@tcp:101:cat.0 00010000:00010000:2.0:1788582118.667573:0:6691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582118.667631:0:6691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000591084fd/0x2bc3aa892c3a7b7c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9482 expref: -99 pid: 6691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788582118.667661:0:6691:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a9b98e2, atime: 0x6a9b98e1, ctime: 0x6a9b98e2, blocks: 0xb 00010000:00010000:2.0:1788582118.667686:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=337s v=(0 0) 00010000:00010000:2.0:1788582118.667691:0:6691:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788582118.667700:0:6691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000591084fd/0x2bc3aa892c3a7b7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9482 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582118.667721:0:6691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000591084fd/0x2bc3aa892c3a7b7c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9482 expref: 8 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582118.667734:0:6691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05e00, rc 0) 00000100:00100000:2.0:1788582118.667815:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbc58a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+8:2352:x1875464002045568:12345-192.168.201.12@tcp:101:cat.0 Request processed in 276us (4943us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582118.667822:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 72 00000100:00080000:3.0:1788582118.668425:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788582118.675559:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582118.675641:0:6697:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002045696 00000100:00100000:1.0:1788582118.675652:0:6697:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002045696 00002000:00100000:1.0:1788582118.675758:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8d0dbab21180 x1875464002045696/t0(0) o3->b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp:719/0 lens 488/0 e 0 to 0 dl 1788582129 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788582118.675769:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0dbab21180 with x1875464002045696 ext(0->4095) 00002000:00010000:1.0:1788582118.675788:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0dbab21180 00000100:00100000:1.0:1788582118.676133:0:6697:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 8 00000100:00100000:1.0:1788582118.676144:0:6697:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b99087a3-3c83-4416-b2b9-d522b9885111+8:2351:x1875464002045696:12345-192.168.201.12@tcp:3:cat.0 00000100:00100000:0.0:1788582118.676648:0:6697:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b99087a3-3c83-4416-b2b9-d522b9885111+8:2351:x1875464002045696:12345-192.168.201.12@tcp:3:cat.0 Request processed in 504us (1106us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788582118.676659:0:6697:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 8 00002000:00100000:0.0:1788582118.676666:0:6697:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff8d0dbab21180 x1875464002045696/t0(0) o3->b99087a3-3c83-4416-b2b9-d522b9885111@192.168.201.12@tcp:719/0 lens 488/4536 e 0 to 0 dl 1788582129 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788582118.676677:0:6697:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0dbab21180 with x1875464002045696 ext(0->4095) 00002000:00010000:0.0:1788582118.676680:0:6697:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0dbab21180 00000001:00080000:1.0:1788582118.950866:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:1.0:1788582118.950887:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:0.0:1788582119.149787:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788582119.778254:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582119.778320:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582119.778337:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002045824 00000100:00100000:1.0:1788582119.778350:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002045824 00000100:00100000:3.0:1788582119.778351:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582119.778380:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582119.778411:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582119.778416:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 294 00000100:00100000:1.0:1788582119.778430:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2352:x1875464002045824:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582119.778443:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002046336 00000100:00100000:3.0:1788582119.778449:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002046336 00000100:00100000:3.0:1788582119.778492:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002045952 00000100:00100000:3.0:1788582119.778496:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002045952 00000100:00100000:1.0:1788582119.778517:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2352:x1875464002045824:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 77us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582119.778519:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 145 00000100:00100000:1.0:1788582119.778532:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 294 00000100:00100000:3.0:1788582119.778535:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2352:x1875464002046336:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582119.778582:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002046080 00000100:00100000:1.0:1788582119.778587:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002046080 00000100:00100000:3.0:1788582119.778588:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2352:x1875464002046336:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 57us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582119.778598:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 145 00000100:00100000:3.0:1788582119.778616:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 146 00000100:00100000:1.0:1788582119.778622:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002046208 00000100:00100000:1.0:1788582119.778627:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002046208 00000100:00100000:3.0:1788582119.778644:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c83085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+31:2352:x1875464002045952:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582119.778653:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 73 00000100:00100000:1.0:1788582119.778663:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbab20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+5:2352:x1875464002046080:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582119.778677:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c83085500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b99087a3-3c83-4416-b2b9-d522b9885111+31:2352:x1875464002045952:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 53us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582119.778685:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 146 00000100:00100000:1.0:1788582119.778700:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbab20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+5:2352:x1875464002046080:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 38us (379us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582119.778708:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 73 00000100:00100000:3.0:1788582119.778715:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 74 00000100:00100000:3.0:1788582119.778724:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dba93d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+8:2352:x1875464002046208:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582119.778754:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dba93d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+8:2352:x1875464002046208:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 32us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582119.778760:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 74 00000100:00080000:3.0:1788582119.778916:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788582119.778921:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788582120.177675:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788582120.483917:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:3.0:1788582120.483941:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000001:00080000:3.0:1788582120.483949:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:1.0:1788582120.496790:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000020:00080000:1.0:1788582120.496811:0:5866:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d0d84ec8480 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788582120.496817:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d0c834a5400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d0d84ec8a80 00000020:00080000:1.0:1788582120.496821:0:5866:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d0c834a5a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d0dc2072800 00000001:00080000:1.0:1788582120.496859:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967518 is committed 00000020:00080000:1.0:1788582120.496868:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1788582120.496880:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1788582120.497091:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788582120.497328:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1788582121.198161:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582121.965736:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c83084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020897280:0@lo:400:kworker.0 00000100:00100000:0.0:1788582121.965810:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582121.965873:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020897792:0@lo:400:kworker.0 00000100:00100000:0.0:1788582121.965901:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582121.965929:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788582121.965950:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c83085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020897408:0@lo:400:kworker.0 00000100:00100000:0.0:1788582121.965975:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582121.966132:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020897536:0@lo:400:kworker.0 00000100:00100000:1.0:1788582121.966161:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582121.966176:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788582121.966181:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c83086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020897152:0@lo:400:kworker.0 00000100:00100000:1.0:1788582121.966222:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582121.966242:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020897664:0@lo:400:kworker.0 00000100:00100000:1.0:1788582121.966260:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582121.966287:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020897792 00000100:00100000:1.0:1788582121.966293:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020897792 00000100:00100000:1.0:1788582121.966337:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020897536 00000100:00100000:1.0:1788582121.966340:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020897536 00000100:00100000:1.0:1788582121.966358:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788582121.966365:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf374700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020897792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582121.966428:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf374700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020897792:12345-0@lo:400:kworker.0 Request processed in 62us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582121.966435:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788582121.966448:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788582121.966453:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020897536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582121.966481:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020897536:12345-0@lo:400:kworker.0 Request processed in 28us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582121.966486:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788582121.966503:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020897152 00000100:00100000:1.0:1788582121.966506:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020897152 00000100:00100000:1.0:1788582121.966552:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788582121.966558:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020897152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582121.966585:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020897152:12345-0@lo:400:kworker.0 Request processed in 28us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582121.966591:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1788582121.966617:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020897280 00000100:00100000:1.0:1788582121.966620:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020897280 00000100:00100000:1.0:1788582121.966639:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020897408 00000100:00100000:1.0:1788582121.966642:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020897408 00000100:00100000:1.0:1788582121.966655:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020897664 00000100:00100000:1.0:1788582121.966657:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020897664 00000100:00100000:1.0:1788582121.966670:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788582121.966676:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020897280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582121.966705:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020897280:12345-0@lo:400:kworker.0 Request processed in 29us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582121.966711:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788582121.966722:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788582121.966727:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020897408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582121.966751:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020897408:12345-0@lo:400:kworker.0 Request processed in 25us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582121.966757:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788582121.966768:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788582121.966773:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020897664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582121.966796:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020897664:12345-0@lo:400:kworker.0 Request processed in 23us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582121.966803:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788582121.966842:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c83086300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020897152:0@lo:400:kworker.0 00000100:00100000:1.0:1788582121.966865:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020897664:0@lo:400:kworker.0 00000100:00100000:1.0:1788582121.966874:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1788582121.966879:0:3308:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1788582121.966899:0:3308:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d0dbbdc1500, transno 4294967310 00000100:00100000:1.0:1788582121.966911:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020897536:0@lo:400:kworker.0 00000100:00100000:0.0:1788582121.967144:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c83085880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020897408:0@lo:400:kworker.0 00000100:00100000:0.0:1788582121.967154:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c83084a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020897280:0@lo:400:kworker.0 00000100:00100000:0.0:1788582121.967162:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:0.0:1788582121.967165:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d0dbbdc2d80, transno 4294967323 00000004:00080000:0.0:1788582121.967173:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:0.0:1788582121.967183:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf430380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020897792:0@lo:400:kworker.0 00000100:00100000:2.0:1788582121.967396:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020897920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788582121.967428:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582121.967455:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020897920 00000100:00100000:2.0:1788582121.967458:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020897920 00000100:00100000:2.0:1788582121.967484:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788582121.967490:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaeabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020897920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788582121.967523:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788582121.967571:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaeabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020897920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582121.967578:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788582121.967610:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020897920:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788582121.968660:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788582121.968669:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788582121.968672:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788582122.222011:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788582122.670557:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788582122.670569:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788582122.670613:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788582122.670620:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788582123.247728:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582123.501476:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788582123.501499:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020898048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788582123.501606:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582123.502320:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020898048 00000100:00100000:3.0:1788582123.502331:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020898048 00000100:00100000:3.0:1788582123.502392:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788582123.502403:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020898048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788582123.502440:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788582123.502444:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788582123.502490:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020898048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582123.502497:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788582123.502828:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020898048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788582123.544386:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582123.544628:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002046464 00000100:00100000:1.0:1788582123.544641:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002046464 00000100:00100000:1.0:1788582123.544735:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 239 00000100:00100000:1.0:1788582123.544747:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+18:11287:x1875464002046464:12345-192.168.201.12@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1788582123.544881:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf430380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+18:11287:x1875464002046464:12345-192.168.201.12@tcp:60:lhsmtool_posix.0 Request processed in 136us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582123.544889:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 239 00000100:00080000:0.0:1788582123.546399:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788582123.549809:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582123.549937:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002046720 00000100:00100000:3.0:1788582123.549948:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002046720 00000100:00100000:3.0:1788582123.550018:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 65 00000100:00100000:3.0:1788582123.550030:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+18:11287:x1875464002046720:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788582123.550391:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+19:11287:x1875464002046720:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 Request processed in 362us (596us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1788582123.550400:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 65 00000100:00100000:2.0:1788582123.818763:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582123.818869:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002046848 00000100:00100000:3.0:1788582123.818882:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002046848 00000100:00100000:3.0:1788582123.818974:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 240 00000100:00100000:3.0:1788582123.818986:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:12089:x1875464002046848:12345-192.168.201.12@tcp:101:lsof.0 00010000:00010000:3.0:1788582123.819007:0:10137:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582123.819028:0:10137:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7b83 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9489 expref: -99 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582123.819120:0:10137:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7b8a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582123.819136:0:10137:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7b8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582123.819148:0:10137:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7b8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582123.819189:0:10137:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788582123.819193:0:10137:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788582123.819258:0:10137:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7b8a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 10137 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582123.819282:0:10137:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26000/0x2bc3aa892c3a7b83 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9489 expref: 7 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582123.819302:0:10137:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7b8a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9489 expref: 6 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582123.819311:0:10137:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d917bd600) 00010000:00010000:3.0:1788582123.819314:0:10137:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788582123.819317:0:10137:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27400, rc 0) 00000100:00100000:3.0:1788582123.819390:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:7a85b5d8-11d7-4e00-8094-5ec4da71e638+6:12089:x1875464002046848:12345-192.168.201.12@tcp:101:lsof.0 Request processed in 407us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582123.819397:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 240 00000100:00080000:0.0:1788582123.819600:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788582124.270178:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582124.895296:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582124.895341:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582124.895377:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582124.895403:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582124.895431:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582124.895470:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002047232 00000100:00100000:0.0:1788582124.895490:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002047232 00000100:00100000:0.0:1788582124.895549:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002047360 00000100:00100000:0.0:1788582124.895553:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002047360 00000100:00100000:0.0:1788582124.895579:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 77 00000100:00100000:0.0:1788582124.895589:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+5:2351:x1875464002047232:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582124.895662:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf374000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+5:2351:x1875464002047232:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 74us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582124.895670:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 77 00000100:00100000:0.0:1788582124.895686:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 78 00000100:00100000:0.0:1788582124.895705:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf374a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+7:2351:x1875464002047360:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582124.895735:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf374a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b99087a3-3c83-4416-b2b9-d522b9885111+7:2351:x1875464002047360:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 31us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582124.895742:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 78 00000100:00100000:0.0:1788582124.895767:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002047488 00000100:00100000:0.0:1788582124.895770:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002047488 00000100:00100000:0.0:1788582124.895853:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002047104 00000100:00100000:0.0:1788582124.895856:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002047104 00000100:00100000:0.0:1788582124.895877:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 150 00000100:00100000:0.0:1788582124.895884:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a85b5d8-11d7-4e00-8094-5ec4da71e638+6:2351:x1875464002047488:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582124.895913:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf376a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a85b5d8-11d7-4e00-8094-5ec4da71e638+6:2351:x1875464002047488:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 29us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582124.895918:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 150 00000100:00100000:0.0:1788582124.895930:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 151 00000100:00100000:0.0:1788582124.895935:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+19:2351:x1875464002047104:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582124.895966:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+19:2351:x1875464002047104:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 31us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582124.895971:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 151 00000100:00080000:0.0:1788582124.895992:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788582124.895996:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788582124.896946:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002046976 00000100:00100000:1.0:1788582124.896956:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002046976 00000100:00100000:1.0:1788582124.897005:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 296 00000100:00100000:1.0:1788582124.897015:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2351:x1875464002046976:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582124.897095:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2351:x1875464002046976:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 81us (1811us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582124.897102:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 296 00010000:00010000:0.0:1788582125.294184:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788582125.590194:0:5866:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:3.0:1788582125.590242:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:2.0:1788582125.590351:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788582125.590364:0:5877:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788582126.317428:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582127.087021:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaeab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020898176:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788582127.087091:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582127.087147:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020898176 00000100:00100000:1.0:1788582127.087159:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020898176 00000100:00080000:2.0:1788582127.087224:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788582127.087320:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788582127.087334:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab434c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020898176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788582127.087377:0:6695:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788582127.087422:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab434c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020898176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582127.087486:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020898304:0@lo:400:kworker.0 00000100:00100000:0.0:1788582127.087520:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582127.087542:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c813a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020898816:0@lo:400:kworker.0 00000100:00100000:0.0:1788582127.087562:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582127.087586:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788582127.087591:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020898432:0@lo:400:kworker.0 00000100:00100000:0.0:1788582127.087609:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582127.087635:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020898304 00000100:00100000:0.0:1788582127.087638:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020898304 00000100:00100000:0.0:1788582127.087665:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788582127.087671:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3306:x1875464020898304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582127.087701:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3306:x1875464020898304:12345-0@lo:400:kworker.0 Request processed in 30us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582127.087707:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788582127.087738:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020898816 00000100:00100000:0.0:1788582127.087741:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020898816 00000100:00100000:0.0:1788582127.087766:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020898432 00000100:00100000:0.0:1788582127.087769:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020898432 00000100:00100000:0.0:1788582127.087788:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788582127.087794:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020898816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582127.088125:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020898816:12345-0@lo:400:kworker.0 Request processed in 29us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582127.088132:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788582127.088146:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788582127.088152:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020898432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582127.088180:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1875464020898432:12345-0@lo:400:kworker.0 Request processed in 29us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582127.088184:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788582127.088244:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020898560:0@lo:400:kworker.0 00000100:00100000:0.0:1788582127.088268:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582127.088285:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788582127.088298:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020898688:0@lo:400:kworker.0 00000100:00100000:0.0:1788582127.088319:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582127.088341:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020898688 00000100:00100000:0.0:1788582127.088344:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020898688 00000100:00100000:0.0:1788582127.088640:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788582127.088647:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020898688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582127.088684:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020898688:12345-0@lo:400:kworker.0 Request processed in 38us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582127.088689:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:0.0:1788582127.088706:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788582127.088710:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788582127.089667:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020898688:0@lo:400:kworker.0 00000100:00100000:0.0:1788582127.089710:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3306:1875464020898432:0@lo:400:kworker.0 00000100:00100000:2.0:1788582127.090054:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020898560 00000100:00100000:2.0:1788582127.090061:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020898560 00000100:00100000:2.0:1788582127.090115:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788582127.090123:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020898560:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582127.090187:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020898560:12345-0@lo:400:kworker.0 Request processed in 65us (1917us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582127.090194:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788582127.090357:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020898304:0@lo:400:kworker.0 00000100:00080000:3.0:1788582127.090638:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788582127.090672:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaeab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020898176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788582127.090865:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c813a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020898816:0@lo:400:kworker.0 00000100:00100000:0.0:1788582127.090903:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020898560:0@lo:400:kworker.0 00000100:00100000:1.0:1788582127.094599:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:0.0:1788582127.342710:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788582127.724903:0:12820:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 00:22:05 (1788582125) 00010000:00010000:0.0:1788582128.365843:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582128.624456:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020898944:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788582128.624545:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582128.624664:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020898944 00000100:00100000:3.0:1788582128.624674:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020898944 00000100:00100000:3.0:1788582128.624728:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788582128.624739:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020898944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788582128.624775:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788582128.624820:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020898944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582128.624827:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788582128.624910:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020898944:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788582129.389400:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582130.036527:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582130.036578:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582130.036615:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582130.036641:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582130.036668:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582130.036698:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002048128 00000100:00100000:2.0:1788582130.036708:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002048128 00000100:00100000:3.0:1788582130.036767:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002047616 00000100:00100000:2.0:1788582130.036772:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002047744 00000100:00100000:3.0:1788582130.036773:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002047616 00000100:00100000:2.0:1788582130.036774:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002047744 00000100:00100000:2.0:1788582130.036797:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 155 00000100:00100000:3.0:1788582130.036800:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 298 00000100:00100000:3.0:1788582130.036807:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2349:x1875464002047616:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788582130.036807:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaeabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a85b5d8-11d7-4e00-8094-5ec4da71e638+6:2349:x1875464002048128:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788582130.036875:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaeabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:7a85b5d8-11d7-4e00-8094-5ec4da71e638+6:2349:x1875464002048128:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 70us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582130.036883:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 155 00000100:00100000:1.0:1788582130.036883:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002047872 00000100:00100000:1.0:1788582130.036886:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002047872 00000100:00100000:2.0:1788582130.036901:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 156 00000100:00100000:2.0:1788582130.036907:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+18:2349:x1875464002047744:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582130.036925:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002048000 00000100:00100000:1.0:1788582130.036928:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002048000 00000100:00100000:1.0:1788582130.036952:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 80 00000100:00100000:1.0:1788582130.036959:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+5:2349:x1875464002047872:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582130.042440:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2349:x1875464002047616:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 5618us (5907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582130.042456:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 298 00000100:00080000:3.0:1788582130.042550:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788582130.042557:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788582130.042560:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788582130.042584:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 81 00000100:00100000:3.0:1788582130.042599:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaeab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+7:2349:x1875464002048000:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582130.042653:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaeab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+7:2349:x1875464002048000:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 60us (5984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582130.042695:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 81 00000100:00100000:2.0:1788582130.048498:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b99087a3-3c83-4416-b2b9-d522b9885111+18:2349:x1875464002047744:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 11577us (11842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582130.048513:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 156 00000100:00100000:1.0:1788582130.054071:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+5:2349:x1875464002047872:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 17097us (17477us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582130.054087:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 80 00010000:00010000:0.0:1788582130.413651:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582131.443587:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788582132.205690:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020899328:0@lo:400:kworker.0 00000100:00100000:3.0:1788582132.205774:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582132.205837:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788582132.205844:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020899456:0@lo:400:kworker.0 00000100:00100000:3.0:1788582132.205882:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582132.205913:0:10137:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020899328 00000100:00100000:3.0:1788582132.205921:0:10137:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020899328 00000100:00100000:3.0:1788582132.205976:0:10137:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788582132.205987:0:10137:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020899328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582132.206037:0:10137:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020899328:12345-0@lo:400:kworker.0 Request processed in 51us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582132.206045:0:10137:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788582132.206067:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020899456 00000100:00100000:3.0:1788582132.206071:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020899456 00000100:00100000:3.0:1788582132.206096:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788582132.206103:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020899456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582132.206133:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020899456:12345-0@lo:400:kworker.0 Request processed in 30us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582132.206139:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:3.0:1788582132.206167:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788582132.206173:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788582132.206227:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020899456:0@lo:400:kworker.0 00000100:00100000:3.0:1788582132.206239:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf433b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020899328:0@lo:400:kworker.0 00000100:00100000:2.0:1788582132.206588:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788582132.206598:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020899840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788582132.206643:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582132.206695:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020899840 00000100:00100000:2.0:1788582132.206699:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020899840 00000100:00100000:2.0:1788582132.206736:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788582132.206755:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020899840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788582132.206786:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788582132.206824:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020899840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (180us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582132.206830:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:2.0:1788582132.206848:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788582132.206881:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020899840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788582132.207081:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020899072:0@lo:400:kworker.0 00000100:00100000:0.0:1788582132.207117:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582132.207160:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020899584:0@lo:400:kworker.0 00000100:00100000:0.0:1788582132.207184:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582132.207223:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788582132.207238:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020899200:0@lo:400:kworker.0 00000100:00100000:0.0:1788582132.207261:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582132.207277:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020899712:0@lo:400:kworker.0 00000100:00100000:0.0:1788582132.207299:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582132.207324:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020899712 00000100:00100000:0.0:1788582132.207329:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020899712 00000100:00100000:0.0:1788582132.207367:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788582132.207375:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020899712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582132.207412:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020899712:12345-0@lo:400:kworker.0 Request processed in 38us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582132.207419:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788582132.207448:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020899712:0@lo:400:kworker.0 00000100:00100000:2.0:1788582132.207649:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020899072 00000100:00100000:2.0:1788582132.207653:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020899072 00000100:00100000:2.0:1788582132.207687:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1788582132.207695:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020899072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582132.207962:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf432300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020899072:0@lo:400:kworker.0 00000100:00100000:2.0:1788582132.207994:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020899072:12345-0@lo:400:kworker.0 Request processed in 48us (624us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582132.208002:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1788582132.208079:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020899584 00000100:00100000:3.0:1788582132.208091:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020899584 00000100:00100000:3.0:1788582132.208139:0:10136:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020899200 00000100:00100000:3.0:1788582132.208150:0:10136:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020899200 00000100:00100000:3.0:1788582132.208179:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788582132.208186:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020899584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582132.208252:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020899584:12345-0@lo:400:kworker.0 Request processed in 67us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582132.208258:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788582132.208270:0:10136:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788582132.208276:0:10136:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020899200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582132.208302:0:10136:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020899200:12345-0@lo:400:kworker.0 Request processed in 27us (1040us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582132.208308:0:10136:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788582132.208341:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf431500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020899200:0@lo:400:kworker.0 00000100:00100000:3.0:1788582132.208351:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020899584:0@lo:400:kworker.0 00000100:00080000:2.0:1788582132.208539:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788582132.461474:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788582132.610826:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582132.610983:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002048384 00000100:00100000:1.0:1788582132.610993:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002048384 00000100:00100000:1.0:1788582132.611081:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 66 00000100:00100000:1.0:1788582132.611093:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+18:12310:x1875464002048384:12345-192.168.201.12@tcp:35:umount.0 00000100:00100000:1.0:1788582132.611535:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+19:12310:x1875464002048384:12345-192.168.201.12@tcp:35:umount.0 Request processed in 443us (719us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1788582132.611544:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 66 00000100:00080000:2.0:1788582132.611684:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788582132.615156:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582132.615304:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002048640 00000100:00100000:3.0:1788582132.615314:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002048640 00000100:00100000:3.0:1788582132.615386:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 67 00000100:00100000:3.0:1788582132.615396:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+19:12310:x1875464002048640:12345-192.168.201.12@tcp:35:umount.0 00000100:00100000:3.0:1788582132.615792:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b99087a3-3c83-4416-b2b9-d522b9885111+20:12310:x1875464002048640:12345-192.168.201.12@tcp:35:umount.0 Request processed in 396us (646us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788582132.615800:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 67 00000100:00100000:0.0:1788582132.619269:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582132.619363:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002048896 00000100:00100000:3.0:1788582132.619374:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002048896 00000100:00100000:3.0:1788582132.619452:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 68 00000100:00100000:3.0:1788582132.619464:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d84ece050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+20:12310:x1875464002048896:12345-192.168.201.12@tcp:35:umount.0 00000100:00100000:3.0:1788582132.619716:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d84ece050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b99087a3-3c83-4416-b2b9-d522b9885111+21:12310:x1875464002048896:12345-192.168.201.12@tcp:35:umount.0 Request processed in 253us (456us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788582132.619724:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 68 00000100:00100000:0.0:1788582132.623183:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582132.623311:0:10138:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002049152 00000100:00100000:1.0:1788582132.623322:0:10138:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002049152 00000100:00100000:1.0:1788582132.623398:0:10138:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 69 00000100:00100000:1.0:1788582132.623410:0:10138:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+21:12310:x1875464002049152:12345-192.168.201.12@tcp:35:umount.0 00000100:00100000:1.0:1788582132.623800:0:10138:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:b99087a3-3c83-4416-b2b9-d522b9885111+22:12310:x1875464002049152:12345-192.168.201.12@tcp:35:umount.0 Request processed in 391us (627us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1788582132.623807:0:10138:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 69 00000100:00100000:0.0:1788582132.627628:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582132.627672:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582132.628057:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002049408 00000100:00100000:3.0:1788582132.628069:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002049408 00000100:00100000:3.0:1788582132.628140:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002049280 00000100:00100000:3.0:1788582132.628143:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002049280 00000100:00100000:3.0:1788582132.628174:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 16 00000100:00100000:3.0:1788582132.628186:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05a4b000-bb80-4acb-83cf-d9c3916564a8+14:2351:x1875464002049408:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582132.628231:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582132.628252:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8167ce00/0x2bc3aa892c3a6b61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c8fd5 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582132.628268:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582132.628320:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05a4b000-bb80-4acb-83cf-d9c3916564a8+13:2351:x1875464002049408:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 138us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582132.628327:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 16 00000100:00100000:3.0:1788582132.628343:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 17 00000100:00100000:3.0:1788582132.628360:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05a4b000-bb80-4acb-83cf-d9c3916564a8+12:2351:x1875464002049280:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582132.628368:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582132.628378:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a6b99 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c900d expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582132.628386:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582132.628416:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05a4b000-bb80-4acb-83cf-d9c3916564a8+11:2351:x1875464002049280:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 67us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582132.628422:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 17 00000100:00100000:0.0:1788582132.633309:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582132.633462:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002049536 00000100:00100000:3.0:1788582132.633472:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002049536 00000100:00100000:3.0:1788582132.633545:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 18 00000100:00100000:3.0:1788582132.633556:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05a4b000-bb80-4acb-83cf-d9c3916564a8+11:2350:x1875464002049536:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582132.633574:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582132.633595:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0dbbe04000/0x2bc3aa892c3a6de5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90d8 expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582132.633612:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582132.633663:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2350:x1875464002049536:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 108us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582132.633671:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 18 00000100:00100000:0.0:1788582132.636914:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582132.637048:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002049920 00000100:00100000:3.0:1788582132.637057:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002049920 00000100:00100000:3.0:1788582132.637129:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 73 00000100:00100000:3.0:1788582132.637139:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+7:2348:x1875464002049920:12345-192.168.201.12@tcp:9:umount.0 00000020:00000080:3.0:1788582132.637173:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a7134 00000020:00010000:3.0:1788582132.637180:0:6693:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d0d86997000: total 0 00000100:00080000:3.0:1788582132.637185:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8d0d86992000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788582132.637258:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:3.0:1788582132.637534:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b99087a3-3c83-4416-b2b9-d522b9885111+5:2348:x1875464002049920:12345-192.168.201.12@tcp:9:umount.0 Request processed in 395us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582132.637541:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 73 00000020:00010000:1.0:1788582132.637607:0:5832:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d0d86997000: total 0 00010000:00010000:1.0:1788582132.637639:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d0d86997000, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788582132.637700:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000591084fd/0x2bc3aa892c3a7b7c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9482 expref: 4 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582132.637745:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a74de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92b4 expref: 3 pid: 6691 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582132.637760:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d0d86997000, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788582132.637771:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582132.637773:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582132.637775:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788582132.638283:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788582132.643985:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582132.644071:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002050048 00000100:00100000:1.0:1788582132.644085:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002050048 00000100:00100000:1.0:1788582132.644162:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 74 00000100:00100000:1.0:1788582132.644173:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+5:2348:x1875464002050048:12345-192.168.201.12@tcp:9:umount.0 00000020:00000080:1.0:1788582132.644236:0:8034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6ed3 00000100:00080000:1.0:1788582132.644245:0:8034:0:(import.c:65:import_set_state_nolock()) ffff8d0da98ac800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788582132.644280:0:8034:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1788582132.644573:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b99087a3-3c83-4416-b2b9-d522b9885111+2:2348:x1875464002050048:12345-192.168.201.12@tcp:9:umount.0 Request processed in 401us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582132.644580:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 74 00000100:00080000:2.0:1788582132.644893:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788582132.645021:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582132.656932:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582132.657281:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002051072 00000100:00100000:3.0:1788582132.657307:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002051072 00000100:00100000:3.0:1788582132.657382:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 241 00000100:00100000:3.0:1788582132.657394:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+22:2348:x1875464002051072:12345-192.168.201.12@tcp:39:umount.0 00000020:00000080:3.0:1788582132.657431:0:5844:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6b6f 00000020:00010000:3.0:1788582132.657450:0:5844:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d0dbfa17000: total 0 00000100:00080000:3.0:1788582132.657455:0:5844:0:(import.c:65:import_set_state_nolock()) ffff8d0dbfa16800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788582132.657486:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:3.0:1788582132.657879:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b99087a3-3c83-4416-b2b9-d522b9885111+21:2348:x1875464002051072:12345-192.168.201.12@tcp:39:umount.0 Request processed in 486us (957us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1788582132.657888:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 241 00000020:00010000:1.0:1788582132.658055:0:5831:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d0dbfa17000: total 0 00010000:00010000:1.0:1788582132.658109:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d0dbfa17000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1788582132.658152:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:1.0:1788582132.658156:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788582132.658163:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088200/0x2bc3aa892c3a74c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92ad expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582132.658184:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:1.0:1788582132.658187:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788582132.658191:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05200/0x2bc3aa892c3a7b3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c946d expref: 19 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582132.658253:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d917bd600) 00010000:00010000:1.0:1788582132.658256:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788582132.658261:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27c00/0x2bc3aa892c3a7540 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92d0 expref: 18 pid: 5845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582132.658274:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:1.0:1788582132.658276:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788582132.658280:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e26400/0x2bc3aa892c3a7b67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c947b expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582132.658290:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:1.0:1788582132.658293:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788582132.658297:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27a00/0x2bc3aa892c3a749f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c929f expref: 16 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582132.658308:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:1.0:1788582132.658311:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788582132.658321:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05a00/0x2bc3aa892c3a6ea9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9102 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582132.658337:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:1.0:1788582132.658339:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788582132.658343:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a783b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c93a9 expref: 14 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582132.658367:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d0d888de500) 00010000:00010000:1.0:1788582132.658369:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582132.658374:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088c00/0x2bc3aa892c3a6e55 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90ed expref: 13 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582132.658392:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff8d0d888de000) 00010000:00010000:1.0:1788582132.658393:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788582132.658397:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7088a00/0x2bc3aa892c3a755c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c92d7 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582132.658410:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff8d0d917bdd00) 00010000:00010000:1.0:1788582132.658413:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788582132.658416:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da7089000/0x2bc3aa892c3a73bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9267 expref: 11 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582132.658429:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff8d0da2faf100) 00010000:00010000:1.0:1788582132.658431:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788582132.658435:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27800/0x2bc3aa892c3a7a5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9435 expref: 10 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582132.658447:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff8d0d85afc700) 00010000:00010000:1.0:1788582132.658455:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788582132.658459:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05600/0x2bc3aa892c3a7196 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c91d4 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582132.658474:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d0da2faf900) 00010000:00010000:1.0:1788582132.658477:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788582132.658481:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0da71fc400/0x2bc3aa892c3a6e39 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90e6 expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582132.658493:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d0dbfa17000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1788582132.658507:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582132.658509:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582132.658511:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788582132.976876:0:11685:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788582132.976887:0:11685:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788582132.977465:0:11685:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788582132.977473:0:11685:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788582133.485450:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582133.741489:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788582133.741604:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020899968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788582133.741690:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582133.742534:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020899968 00000100:00100000:2.0:1788582133.742548:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020899968 00000100:00100000:2.0:1788582133.742668:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788582133.742679:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020899968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788582133.742731:0:6694:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788582133.742795:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020899968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582133.742802:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788582133.742886:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020899968:0@lo:13:osp-pre-0-0.0 00000001:00100000:1.0:1788582134.378425:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b99087a3-3c83-4416-b2b9-d522b9885111 00000020:00000080:1.0:1788582134.378433:0:6716:0:(genops.c:885:class_export_put()) final put ffff8d0da98aa000/b99087a3-3c83-4416-b2b9-d522b9885111 00000020:00000080:2.0:1788582134.378534:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0da98aa000/b99087a3-3c83-4416-b2b9-d522b9885111 for lustre-OST0000 00000020:00000080:2.0:1788582134.378591:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d0da98ac800 for lustre-OST0000 00010000:00010000:0.0:1788582134.509459:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582134.820938:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582134.821098:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002051200 00000100:00100000:1.0:1788582134.821109:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002051200 00000100:00100000:1.0:1788582134.821187:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 19 00000100:00100000:1.0:1788582134.821198:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:05a4b000-bb80-4acb-83cf-d9c3916564a8+10:2349:x1875464002051200:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788582134.821245:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582134.821265:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8138fe00/0x2bc3aa892c3a6c41 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9022 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582134.821281:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788582134.821358:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:05a4b000-bb80-4acb-83cf-d9c3916564a8+9:2349:x1875464002051200:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 161us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582134.821365:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 19 00000100:00100000:2.0:1788582134.823607:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582134.823686:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002051456 00000100:00100000:3.0:1788582134.823698:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002051456 00000100:00100000:3.0:1788582134.823817:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 20 00000100:00100000:3.0:1788582134.823829:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaeaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05a4b000-bb80-4acb-83cf-d9c3916564a8+9:2352:x1875464002051456:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582134.823845:0:5830:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582134.823866:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0dbbe04c00/0x2bc3aa892c3a6dde lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c90d1 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582134.823891:0:5830:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582134.823970:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaeaa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:05a4b000-bb80-4acb-83cf-d9c3916564a8+8:2352:x1875464002051456:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 143us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582134.823978:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 20 00000100:00100000:2.0:1788582134.827395:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582134.827529:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002051328 00000100:00100000:1.0:1788582134.827541:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002051328 00000100:00100000:1.0:1788582134.827652:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 21 00000100:00100000:1.0:1788582134.827664:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da7246450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:05a4b000-bb80-4acb-83cf-d9c3916564a8+8:2350:x1875464002051328:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788582134.827679:0:5829:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582134.827697:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8138f600/0x2bc3aa892c3a6c48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c904c expref: 8 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582134.827848:0:5829:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788582134.828343:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da7246450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:05a4b000-bb80-4acb-83cf-d9c3916564a8+7:2350:x1875464002051328:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 679us (956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582134.828352:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 21 00000100:00100000:1.0:1788582134.832516:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582134.832608:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002051712 00000100:00100000:3.0:1788582134.832618:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002051712 00000100:00100000:3.0:1788582134.832747:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 242 00000100:00100000:3.0:1788582134.832758:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a85b5d8-11d7-4e00-8094-5ec4da71e638+6:2348:x1875464002051712:12345-192.168.201.12@tcp:39:umount.0 00000020:00000080:3.0:1788582134.832838:0:5845:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6c56 00000020:00010000:3.0:1788582134.832848:0:5845:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d0da700e000: total 0 00000100:00080000:3.0:1788582134.832853:0:5845:0:(import.c:65:import_set_state_nolock()) ffff8d0da7008800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788582134.832895:0:5845:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1788582134.833580:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:7a85b5d8-11d7-4e00-8094-5ec4da71e638+5:2348:x1875464002051712:12345-192.168.201.12@tcp:39:umount.0 Request processed in 819us (1070us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1788582134.833590:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 242 00000020:00010000:0.0:1788582134.833875:0:5831:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d0da700e000: total 0 00010000:00010000:0.0:1788582134.833881:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582134.833933:0:5831:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d0da700e000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788582134.833976:0:5831:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d917bd600) 00010000:00010000:0.0:1788582134.833980:0:5831:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788582134.833987:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d88e27400/0x2bc3aa892c3a7b8a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9489 expref: 4 pid: 10137 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582134.834011:0:5831:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d0da700e000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788582134.834021:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582134.834023:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582134.834025:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788582134.835565:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788582134.855534:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582134.856069:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002051968 00000100:00100000:3.0:1788582134.856081:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002051968 00000100:00100000:3.0:1788582134.856160:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 300 00000100:00100000:3.0:1788582134.856171:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90c6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+7:2348:x1875464002051968:12345-192.168.201.12@tcp:251:umount.0 00000020:00000080:3.0:1788582134.856254:0:5838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6b4c 00000020:00010000:3.0:1788582134.856262:0:5838:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d0dbfa12000: total 0 00000100:00080000:3.0:1788582134.856267:0:5838:0:(import.c:65:import_set_state_nolock()) ffff8d0dbfa13800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788582134.856351:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90c6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:05a4b000-bb80-4acb-83cf-d9c3916564a8+3:2348:x1875464002051968:12345-192.168.201.12@tcp:251:umount.0 Request processed in 182us (827us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582134.856360:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 300 00000020:00010000:0.0:1788582134.856533:0:5832:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d0dbfa12000: total 0 00010000:00010000:0.0:1788582134.856575:0:5832:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d0dbfa12000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788582134.856605:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8138e000/0x2bc3aa892c3a6ba0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9014 expref: 2 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582134.856619:0:5832:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d0dbfa12000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788582134.856628:0:5832:0:(genops.c:885:class_export_put()) final put ffff8d0dbfa12000/05a4b000-bb80-4acb-83cf-d9c3916564a8 00010000:00010000:0.0:1788582134.856643:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582134.856645:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582134.856647:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788582134.857593:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dbfa12000/05a4b000-bb80-4acb-83cf-d9c3916564a8 for MGS 00000020:00000080:3.0:1788582134.857874:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d0dbfa13800 for MGS 00010000:00010000:1.0:1788582135.534489:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788582135.840932:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b99087a3-3c83-4416-b2b9-d522b9885111 00000020:00000080:3.0:1788582135.840944:0:7648:0:(genops.c:885:class_export_put()) final put ffff8d0d86997000/b99087a3-3c83-4416-b2b9-d522b9885111 00000020:00000080:1.0:1788582135.842994:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0d86997000/b99087a3-3c83-4416-b2b9-d522b9885111 for lustre-OST0001 00000020:00000080:1.0:1788582135.843186:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d0d86992000 for lustre-OST0001 00000001:00080000:3.0:1788582135.851292:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:3.0:1788582135.851324:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 7a85b5d8-11d7-4e00-8094-5ec4da71e638 00000001:00080000:3.0:1788582135.851329:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:3.0:1788582135.851332:0:5866:0:(genops.c:885:class_export_put()) final put ffff8d0da700e000/7a85b5d8-11d7-4e00-8094-5ec4da71e638 00000001:00100000:3.0:1788582135.851347:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b99087a3-3c83-4416-b2b9-d522b9885111 00000001:00080000:3.0:1788582135.851351:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:3.0:1788582135.851366:0:5866:0:(genops.c:885:class_export_put()) final put ffff8d0dbfa17000/b99087a3-3c83-4416-b2b9-d522b9885111 00000020:00000080:3.0:1788582135.851378:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0da700e000/7a85b5d8-11d7-4e00-8094-5ec4da71e638 for lustre-MDT0000 00000020:00000080:3.0:1788582135.851430:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dbfa17000/b99087a3-3c83-4416-b2b9-d522b9885111 for lustre-MDT0000 00000020:00000080:3.0:1788582135.851458:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d0da7008800 for lustre-MDT0000 00000020:00000080:3.0:1788582135.851462:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d0dbfa16800 for lustre-MDT0000 00010000:00010000:1.0:1788582136.558341:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788582136.885174:0:13019:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788582136.893350:0:13019:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1788582136.893416:0:13019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7089200/0x2bc3aa892c3a6bdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6be6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.893434:0:13019:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7089200/0x2bc3aa892c3a6bdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6be6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.893453:0:13019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7089200/0x2bc3aa892c3a6bdf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bc3aa892c3a6be6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.893459:0:13019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.112@tcp lock: ffff8d0da7089200/0x2bc3aa892c3a6bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bc3aa892c3a6be6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.893483:0:13019:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788582136.893488:0:13019:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788582136.893512:0:13019:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788582136.893518:0:13019:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788582136.893523:0:13019:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788582136.893546:0:13019:0:(import.c:65:import_set_state_nolock()) ffff8d0dbbc4f800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788582136.893608:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c813a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875464020900096:0@lo:39:umount.0 00010000:00010000:1.0:1788582136.894004:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788582136.894114:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582136.894187:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020900096 00000100:00100000:0.0:1788582136.894194:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020900096 00000100:00100000:0.0:1788582136.894266:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788582136.894295:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875464020900096:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788582136.894325:0:5843:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a695b 00000100:00080000:0.0:1788582136.894334:0:5843:0:(import.c:65:import_set_state_nolock()) ffff8d0d90c04000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788582136.894403:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3305:x1875464020900096:12345-0@lo:39:umount.0 Request processed in 127us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582136.894410:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000020:00000080:0.0:1788582136.894418:0:5843:0:(genops.c:885:class_export_put()) final put ffff8d0d90c03000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1788582136.894449:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788582136.894475:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0dbbc4f800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788582136.894485:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c813a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875464020900096:0@lo:39:umount.0 00000100:00080000:0.0:1788582136.894516:0:13019:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788582136.894518:0:13019:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788582136.894522:0:13019:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788582136.894753:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0da7089200/0x2bc3aa892c3a6bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bc3aa892c3a6be6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582136.894763:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089200 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:1.0:1788582136.894767:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0da7089200/0x2bc3aa892c3a6bdf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bc3aa892c3a6be6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582136.894776:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0da7089200/0x2bc3aa892c3a6bdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bc3aa892c3a6be6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788582136.894783:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0da7089200/0x2bc3aa892c3a6bdf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bc3aa892c3a6be6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788582136.894798:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788582136.894800:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788582136.894803:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788582136.894835:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0da7089200/0x2bc3aa892c3a6bdf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bc3aa892c3a6be6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582136.894841:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788582136.894859:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0da7089200/0x2bc3aa892c3a6bdf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bc3aa892c3a6be6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582136.894865:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0da7089200/0x2bc3aa892c3a6bdf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bc3aa892c3a6be6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582136.894877:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582136.894879:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582136.894881:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582136.894893:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020900224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788582136.894927:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:2.0:1788582136.895232:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0d90c03000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788582136.895321:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d0d90c04000 for lustre-MDT0000 00000100:00100000:2.0:1788582136.895340:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020900224 00000100:00100000:2.0:1788582136.895346:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020900224 00000100:00100000:2.0:1788582136.895389:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788582136.895396:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+19:3308:x1875464020900224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788582136.895408:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582136.895422:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8167c600/0x2bc3aa892c3a6be6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bc3aa892c3a6bdf expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582136.895437:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582136.895473:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:3308:x1875464020900224:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582136.895480:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788582136.895510:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020900224:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788582136.898449:0:13019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a6bed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6bf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.898467:0:13019:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a6bed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6bf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.898474:0:13019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a6bed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bc3aa892c3a6bf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.898481:0:13019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a6bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bc3aa892c3a6bf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.898505:0:13019:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788582136.898511:0:13019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a6b06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6b0d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.898517:0:13019:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a6b06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6b0d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.898523:0:13019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a6b06 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bc3aa892c3a6b0d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.898529:0:13019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a6b06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bc3aa892c3a6b0d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.898542:0:13019:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788582136.898562:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788582136.898581:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a6bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bc3aa892c3a6bf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.898588:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27600 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:0.0:1788582136.898592:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a6bed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bc3aa892c3a6bf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.898600:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a6bed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bc3aa892c3a6bf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788582136.898606:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a6bed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bc3aa892c3a6bf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788582136.898612:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788582136.898614:0:7637:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1788582136.898647:0:7637:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a6bed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bc3aa892c3a6bf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.898652:0:7637:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788582136.898857:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a6bed lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bc3aa892c3a6bf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.898865:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a6bed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bc3aa892c3a6bf4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.898878:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788582136.898881:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a6b06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bc3aa892c3a6b0d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.898886:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8167ca00 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:0.0:1788582136.898889:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a6b06 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bc3aa892c3a6b0d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.898904:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a6b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bc3aa892c3a6b0d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788582136.898909:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a6b06 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bc3aa892c3a6b0d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788582136.898914:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788582136.898916:0:7637:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788582136.898918:0:7637:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788582136.898933:0:7637:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a6b06 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bc3aa892c3a6b0d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.898937:0:7637:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788582136.898952:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a6b06 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bc3aa892c3a6b0d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.898958:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d8167ca00/0x2bc3aa892c3a6b06 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bc3aa892c3a6b0d expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.898971:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582136.898973:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582136.898975:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582136.898991:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c813a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020900480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788582136.899064:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582136.899124:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020900480 00000100:00100000:0.0:1788582136.899131:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020900480 00000100:00100000:0.0:1788582136.899174:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788582136.899183:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:3306:x1875464020900480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788582136.899196:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582136.899234:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0da7089600/0x2bc3aa892c3a6b0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bc3aa892c3a6b06 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.899248:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788582136.899292:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:3306:x1875464020900480:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582136.899299:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788582136.899325:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c813a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020900352:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788582136.899347:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582136.899385:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c813a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020900480:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788582136.899405:0:13019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05c00/0x2bc3aa892c3a6e08 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6e0f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.899413:0:13019:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05c00/0x2bc3aa892c3a6e08 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6e0f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.899419:0:13019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05c00/0x2bc3aa892c3a6e08 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bc3aa892c3a6e0f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.899426:0:13019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05c00/0x2bc3aa892c3a6e08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bc3aa892c3a6e0f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.899438:0:13019:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788582136.899445:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788582136.899449:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05c00/0x2bc3aa892c3a6e08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bc3aa892c3a6e0f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.899455:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05c00 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:0.0:1788582136.899458:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05c00/0x2bc3aa892c3a6e08 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bc3aa892c3a6e0f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.899470:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05c00/0x2bc3aa892c3a6e08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bc3aa892c3a6e0f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788582136.899476:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05c00/0x2bc3aa892c3a6e08 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bc3aa892c3a6e0f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788582136.899482:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788582136.899484:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788582136.899486:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788582136.899499:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05c00/0x2bc3aa892c3a6e08 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bc3aa892c3a6e0f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.899505:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788582136.899515:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05c00/0x2bc3aa892c3a6e08 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bc3aa892c3a6e0f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.899521:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05c00/0x2bc3aa892c3a6e08 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bc3aa892c3a6e0f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.899528:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582136.899530:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582136.899531:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582136.899537:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788582136.899543:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c813a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020900608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788582136.899562:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788582136.899583:0:13019:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8167de00/0x2bc3aa892c3a68ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a68c1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.899590:0:13019:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8167de00/0x2bc3aa892c3a68ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a68c1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.899601:0:13019:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8167de00/0x2bc3aa892c3a68ba lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bc3aa892c3a68c1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.899607:0:13019:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.112@tcp lock: ffff8d0d8167de00/0x2bc3aa892c3a68ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bc3aa892c3a68c1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582136.899734:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020900352 00000100:00100000:2.0:1788582136.899748:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020900352 00000100:00100000:2.0:1788582136.899774:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020900608 00000100:00100000:2.0:1788582136.899776:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020900608 00000100:00100000:2.0:1788582136.899790:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788582136.899796:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+18:3309:x1875464020900352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788582136.899804:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582136.899812:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8138e600/0x2bc3aa892c3a6bf4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bc3aa892c3a6bed expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582136.899821:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582136.899848:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+17:3309:x1875464020900352:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582136.899854:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788582136.899865:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788582136.899870:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+16:3306:x1875464020900608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788582136.899875:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582136.899882:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0da7088800/0x2bc3aa892c3a6e0f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bc3aa892c3a6e08 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582136.899889:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582136.899909:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:3306:x1875464020900608:12345-0@lo:103:ldlm_bl.0 Request processed in 39us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582136.899914:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788582136.899937:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c813a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020900352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788582136.899953:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c813a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3306:1875464020900608:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788582136.903955:0:13019:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788582136.903964:0:13019:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788582136.903970:0:13019:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:0.0:1788582136.904037:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788582136.904045:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d8167de00/0x2bc3aa892c3a68ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bc3aa892c3a68c1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.904055:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8167de00 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:0.0:1788582136.904059:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8167de00/0x2bc3aa892c3a68ba lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bc3aa892c3a68c1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.904070:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d8167de00/0x2bc3aa892c3a68ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bc3aa892c3a68c1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788582136.904079:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8167de00/0x2bc3aa892c3a68ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bc3aa892c3a68c1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788582136.904085:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788582136.904088:0:7637:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788582136.904090:0:7637:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788582136.904128:0:7637:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d8167de00/0x2bc3aa892c3a68ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bc3aa892c3a68c1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.904135:0:7637:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788582136.904184:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d8167de00/0x2bc3aa892c3a68ba lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bc3aa892c3a68c1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.904193:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d8167de00/0x2bc3aa892c3a68ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bc3aa892c3a68c1 expref: -99 pid: 5824 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.904228:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582136.904230:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582136.904232:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582136.904242:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788582136.904262:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c813a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020900736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788582136.904353:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582136.904406:0:7636:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020900736 00000100:00100000:0.0:1788582136.904414:0:7636:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020900736 00000100:00100000:0.0:1788582136.904470:0:7636:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788582136.904480:0:7636:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+15:3309:x1875464020900736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788582136.904492:0:7636:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582136.904507:0:7636:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8167d000/0x2bc3aa892c3a68c1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bc3aa892c3a68ba expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582136.904520:0:7636:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788582136.904806:0:7636:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b+14:3309:x1875464020900736:12345-0@lo:103:ldlm_bl.0 Request processed in 326us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582136.904814:0:7636:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788582136.904859:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c813a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020900736:0@lo:103:ldlm_bl.0 00000020:01000004:0.0:1788582136.904888:0:13019:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788582136.904892:0:13019:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788582136.904898:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788582136.904904:0:13019:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788582136.904916:0:13019:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d0dbae3b000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788582136.904922:0:13019:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d0dbf7b7000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788582136.904928:0:13019:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8d0d91a13370) has exports, disconnecting them 00000020:00080000:0.0:1788582136.904933:0:13019:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d0dbae3b000), last request at 1788582132 00000020:00000080:0.0:1788582136.904940:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6ace 00000100:00080000:0.0:1788582136.904957:0:13019:0:(import.c:65:import_set_state_nolock()) ffff8d0c8302c000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788582136.904996:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788582136.905021:0:13019:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d0dbae3b000): rc 0 00000020:00000080:0.0:1788582136.905024:0:13019:0:(genops.c:885:class_export_put()) final put ffff8d0dbae3b000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:3.0:1788582136.905782:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788582136.905884:0:13019:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d0dbf7b7000), last request at 1788582132 00000020:00000080:0.0:1788582136.905891:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6a03 00000100:00080000:0.0:1788582136.905898:0:13019:0:(import.c:65:import_set_state_nolock()) ffff8d0dbf7b4000 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1788582136.905916:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788582136.905926:0:13019:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d0dbf7b7000): rc 0 00000020:00000080:0.0:1788582136.905928:0:13019:0:(genops.c:885:class_export_put()) final put ffff8d0dbf7b7000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:0.0:1788582136.905939:0:13019:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffa643841c3ae0 00000100:00080000:0.0:1788582136.905961:0:13019:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1788582136.905966:0:13019:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:0.0:1788582136.905979:0:13019:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1788582136.906219:0:13019:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1788582136.906239:0:13019:0:(import.c:65:import_set_state_nolock()) ffff8d0c8302d000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1788582136.906255:0:13019:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1788582136.906257:0:13019:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:0.0:1788582136.906270:0:13019:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788582136.906356:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c813a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020900864:0@lo:9:umount.0 00000100:00100000:0.0:1788582136.906412:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582136.906461:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020900864 00000100:00100000:0.0:1788582136.906467:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020900864 00000100:00100000:0.0:1788582136.906531:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788582136.906539:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1875464020900864:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788582136.906576:0:6693:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6a50 00000100:00080000:0.0:1788582136.906582:0:6693:0:(import.c:65:import_set_state_nolock()) ffff8d0c83028800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788582136.906625:0:6693:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788582136.907238:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3305:x1875464020900864:12345-0@lo:9:umount.0 Request processed in 698us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582136.907247:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1788582136.907273:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788582136.907315:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0c8302d000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788582136.907325:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788582136.907327:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788582136.907332:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c813a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020900864:0@lo:9:umount.0 00000100:00080000:0.0:1788582136.907367:0:13019:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1788582136.907381:0:13019:0:(import.c:65:import_set_state_nolock()) ffff8d0d920f5000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788582136.907401:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020900992:0@lo:9:umount.0 00000100:00100000:0.0:1788582136.907429:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582136.907462:0:8034:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020900992 00000100:00100000:0.0:1788582136.907467:0:8034:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020900992 00000100:00100000:0.0:1788582136.907499:0:8034:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788582136.907506:0:8034:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1875464020900992:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788582136.907523:0:8034:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6b37 00000100:00080000:0.0:1788582136.907530:0:8034:0:(import.c:65:import_set_state_nolock()) ffff8d0dbfa12800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788582136.907733:0:8034:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1788582136.907950:0:8034:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf377480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3305:x1875464020900992:12345-0@lo:9:umount.0 Request processed in 443us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582136.907957:0:8034:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:0.0:1788582136.907989:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788582136.908005:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0d920f5000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788582136.909100:0:3305:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788582136.909107:0:3305:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788582136.909114:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020900992:0@lo:9:umount.0 00000100:00080000:2.0:1788582136.913155:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788582136.913175:0:5839:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1788582136.913298:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dbae3b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1788582136.913359:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dbf7b7000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1788582136.913387:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d0c8302c000 for lustre-MDT0000 00000020:00000080:1.0:1788582136.913392:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d0dbf7b4000 for lustre-MDT0000 00000020:00080000:0.0:1788582136.914860:0:13019:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8d0d91a13370) has no exports 00000020:00080000:0.0:1788582136.923132:0:13019:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8d0d91a13370) has no exports 00000020:00000080:0.0:1788582136.978041:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6915 00000020:00000080:0.0:1788582136.978057:0:13019:0:(genops.c:885:class_export_put()) final put ffff8d0dac379800/lustre-QMT0000_UUID 00000020:01000000:0.0:1788582136.978117:0:13019:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788582136.978183:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788582136.978193:0:13019:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788582136.978197:0:13019:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8d0d97e9b370) has no exports 00000020:00000080:0.0:1788582136.978630:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a690e 00000020:00000080:0.0:1788582136.978637:0:13019:0:(genops.c:885:class_export_put()) final put ffff8d0dbbc4e800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788582136.978925:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dac379800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1788582136.979162:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dbbc4e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788582136.979375:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788582136.979386:0:13019:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788582136.979390:0:13019:0:(genops.c:885:class_export_put()) final put ffff8d0dbbc49000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788582136.979393:0:13019:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dbbc49000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788582136.979401:0:13019:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:0.0:1788582136.979541:0:13019:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d0d90fae180 - data ffff8d0dbfe97d80/ffff8d0dbf28d800 00000020:01000000:0.0:1788582136.979861:0:13019:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d0d90938780 - data ffff8d0db13225e8/ffff8d0d97edf800 00000001:00000004:0.0:1788582136.994807:0:13019:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788582137.084624:0:13019:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788582137.084647:0:13019:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788582137.084685:0:13019:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788582137.084688:0:13019:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1788582137.086224:0:6994:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1788582137.086230:0:6994:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1788582137.086243:0:6994:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788582137.088257:0:13019:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788582137.088265:0:13019:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:2.0:1788582137.088322:0:13019:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788582137.088327:0:13019:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788582137.088553:0:8025:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788582137.088559:0:8025:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:3.0:1788582137.088570:0:8025:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1788582137.130339:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a68dd 00000020:00000080:2.0:1788582137.130352:0:13019:0:(genops.c:885:class_export_put()) final put ffff8d0dac39d800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788582137.130806:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dac39d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788582137.132398:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a68f2 00000020:00000080:2.0:1788582137.132411:0:13019:0:(genops.c:885:class_export_put()) final put ffff8d0dac39e800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1788582137.132461:0:13019:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1788582137.132469:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788582137.132478:0:13019:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788582137.132482:0:13019:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8d0d91a14d28) has no exports 00000004:01000000:2.0:1788582137.132646:0:13019:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1788582137.132671:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6b30 00000020:00000080:2.0:1788582137.132677:0:13019:0:(genops.c:885:class_export_put()) final put ffff8d0dab592000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788582137.132862:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dac39e800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788582137.132956:0:13019:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788582137.132961:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788582137.132969:0:13019:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788582137.132971:0:13019:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8d0dbfb43370) has no exports 00000020:00000080:2.0:1788582137.132978:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6b29 00000020:00000080:2.0:1788582137.132982:0:13019:0:(genops.c:885:class_export_put()) final put ffff8d0dae9d6000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788582137.132998:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dab592000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:2.0:1788582137.133520:0:13019:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1788582137.133526:0:13019:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788582137.133531:0:13019:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:2.0:1788582137.133536:0:13019:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788582137.133549:0:13019:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788582137.133778:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dae9d6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788582137.133921:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788582137.133931:0:13019:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788582137.133937:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6a49 00000020:00000080:2.0:1788582137.133944:0:13019:0:(genops.c:885:class_export_put()) final put ffff8d0dbf281800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788582137.133967:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d0d920f5000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788582137.133972:0:38:0:(genops.c:885:class_export_put()) final put ffff8d0dbbd40000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788582137.133974:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dbbd40000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788582137.133978:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1788582137.134094:0:13019:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1788582137.134099:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788582137.134103:0:13019:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788582137.134106:0:13019:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8d0dbf4e0000) has no exports 00000020:00000080:2.0:1788582137.134111:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6a42 00000020:00000080:2.0:1788582137.134114:0:13019:0:(genops.c:885:class_export_put()) final put ffff8d0c8302a000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788582137.134188:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dbf281800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1788582137.134402:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0c8302a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1788582137.134984:0:13019:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788582137.134988:0:13019:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788582137.134992:0:13019:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1788582137.134996:0:13019:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788582137.134999:0:13019:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788582137.135288:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788582137.135296:0:13019:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788582137.135323:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788582137.135327:0:13019:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788582137.135344:0:13019:0:(genops.c:885:class_export_put()) final put ffff8d0d84fa2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788582137.135347:0:13019:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0d84fa2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788582137.135353:0:13019:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788582137.135501:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a68f9 00000020:00000080:3.0:1788582137.135506:0:13019:0:(genops.c:885:class_export_put()) final put ffff8d0dac399800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788582137.137951:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d0c8302d000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788582137.137967:0:38:0:(genops.c:885:class_export_put()) final put ffff8d0dabd31000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788582137.137970:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dabd31000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788582137.137979:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788582137.139781:0:13019:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788582137.139898:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dac399800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788582137.139922:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788582137.139932:0:13019:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788582137.139937:0:13019:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8d0d91a10000) has no exports 00000020:00000080:2.0:1788582137.139969:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788582137.139975:0:13019:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788582137.139980:0:13019:0:(genops.c:885:class_export_put()) final put ffff8d0dac399000/lustre-MDD0000_UUID 00000020:00000080:2.0:1788582137.139983:0:13019:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dac399000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788582137.139987:0:13019:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1788582137.140643:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6900 00000020:00000080:2.0:1788582137.140774:0:13019:0:(genops.c:885:class_export_put()) final put ffff8d0dac39b800/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788582137.140880:0:13019:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d0d945e5800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788582137.140884:0:13019:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0d945e5800 3 00000020:01000004:2.0:1788582137.140888:0:13019:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d0d945e5800 from lustre-MDT0000 00000020:00000080:2.0:1788582137.140916:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788582137.140923:0:13019:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788582137.140926:0:13019:0:(genops.c:885:class_export_put()) final put ffff8d0dac39e000/lustre-MDT0000_UUID 00000020:00000080:2.0:1788582137.140941:0:13019:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dac39e000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788582137.140949:0:13019:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788582137.140982:0:13019:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1788582137.140985:0:13019:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788582137.140990:0:13019:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788582137.140994:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788582137.140997:0:13019:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788582137.141005:0:13019:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8d0da7184000 440dcdbb-2cf9-4bb9-89ca-da9aec3e214b 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788582137.141010:0:13019:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8d0d9ddeb370) has exports, disconnecting them 00000020:00080000:2.0:1788582137.141016:0:13019:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8d0da7184000), last request at 1788581926 00000020:00000080:2.0:1788582137.141032:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a689e 00000020:00010000:2.0:1788582137.141036:0:13019:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d0da7184000: total 1 00000100:00080000:2.0:1788582137.141040:0:13019:0:(import.c:65:import_set_state_nolock()) ffff8d0da7186800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788582137.141060:0:13019:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d0da7184000): rc 0 00000020:00080000:2.0:1788582137.141064:0:13019:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8d0d9ddeb370) has no exports 00000100:00100000:2.0:1788582137.141116:0:5836:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8d0d88e54600:5836] 0 exiting: rc = 1 00000100:00100000:2.0:1788582137.141238:0:5837:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8d0da71e1800:5837] 1 exiting: rc = 0 00000020:00010000:1.0:1788582137.141370:0:7637:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d0da7184000: total 1 00010000:00010000:1.0:1788582137.141408:0:7637:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d0da7184000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788582137.141436:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d80030000/0x2bc3aa892c3a69b6 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bc3aa892c3a69af expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582137.141465:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8138fa00/0x2bc3aa892c3a6c02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bc3aa892c3a6bfb expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582137.141475:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0da7088e00/0x2bc3aa892c3a6e01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bc3aa892c3a6dfa expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582137.141485:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d88e26600/0x2bc3aa892c3a6bae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bc3aa892c3a6ba7 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582137.141494:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d88e26a00/0x2bc3aa892c3a6bca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bc3aa892c3a6bc3 expref: 5 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582137.141502:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8167d200/0x2bc3aa892c3a6bbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bc3aa892c3a6bb5 expref: 4 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582137.141511:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0dbbe04200/0x2bc3aa892c3a6df3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bc3aa892c3a6dec expref: 3 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582137.141522:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8138f200/0x2bc3aa892c3a6bd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x2bc3aa892c3a6bd1 expref: 2 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582137.141532:0:7637:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d0da7184000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788582137.141544:0:7637:0:(genops.c:885:class_export_put()) final put ffff8d0da7184000/440dcdbb-2cf9-4bb9-89ca-da9aec3e214b 00000020:00000080:3.0:1788582137.141588:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dac39b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1788582137.141618:0:5838:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8d0da71e1400:5838] 2 exiting: rc = 0 00000100:00100000:2.0:1788582137.141980:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.141989:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.141995:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142003:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142008:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142014:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142020:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142027:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142032:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142038:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142045:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142050:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142055:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142061:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142067:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142083:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142088:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142094:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142099:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142104:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142109:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142114:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142120:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142124:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142195:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142226:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142232:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142239:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142244:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142250:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142255:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142260:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142265:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142270:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142286:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142292:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142297:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142303:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142311:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142317:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142322:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142328:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142333:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142339:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142344:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142350:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142355:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142360:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142366:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142371:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142384:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142389:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142394:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142400:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142405:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142411:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142416:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142422:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142428:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142434:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142440:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142446:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142451:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.142457:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1788582137.144022:0:13019:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788582137.144029:0:13019:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:1.0:1788582137.144466:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582137.144470:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582137.144473:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788582137.144522:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0da7184000/440dcdbb-2cf9-4bb9-89ca-da9aec3e214b for MGS 00000020:00000080:3.0:1788582137.144624:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d0da7186800 for MGS 00000020:01000000:1.0:1788582137.145443:0:13019:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d0d90faef00 - data ffff8d0db136c510/ffff8d0dbf79f000 00000020:01000000:1.0:1788582137.145591:0:13019:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d0da72934e0 - data ffff8d0db13980d8/ffff8d0d87218800 00000020:00000080:1.0:1788582137.146850:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6882 00000020:00000080:1.0:1788582137.146871:0:13019:0:(genops.c:885:class_export_put()) final put ffff8d0da7185000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788582137.146887:0:13019:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d0d945e5800 from MGS, refs=2 00000020:01000004:1.0:1788582137.146890:0:13019:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0d945e5800 2 00000020:01000004:1.0:1788582137.146893:0:13019:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d0d945e5800 from MGS 00000020:00000080:1.0:1788582137.146917:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788582137.146924:0:13019:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788582137.146927:0:13019:0:(genops.c:885:class_export_put()) final put ffff8d0d945ae800/MGS 00000020:00000080:1.0:1788582137.146929:0:13019:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0d945ae800/MGS for MGS 00000020:01000000:1.0:1788582137.146937:0:13019:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788582137.146996:0:13019:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788582137.146999:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788582137.147004:0:13019:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788582137.147012:0:13019:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8d0dbbc4c000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788582137.147018:0:13019:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff8d0d97e98000) has exports, disconnecting them 00000020:00080000:1.0:1788582137.147022:0:13019:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8d0dbbc4c000), last request at 1788581927 00000020:00000080:1.0:1788582137.147027:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a694d 00000020:00080000:1.0:1788582137.147038:0:13019:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d0dbbc4c000): rc 0 00000020:00000080:1.0:1788582137.147043:0:13019:0:(genops.c:885:class_export_put()) final put ffff8d0dbbc4c000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788582137.153081:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0da7185000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788582137.153102:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dbbc4c000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788582137.179295:0:13019:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788582137.179309:0:13019:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788582137.179314:0:13019:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788582137.179323:0:13019:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788582137.179538:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788582137.179548:0:13019:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788582137.179555:0:13019:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0d945e5800 1 00000020:00000080:2.0:1788582137.179562:0:13019:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6874 00000020:00000080:2.0:1788582137.179571:0:13019:0:(genops.c:885:class_export_put()) final put ffff8d0d945ad800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788582137.179577:0:13019:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788582137.179581:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788582137.179585:0:13019:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788582137.179588:0:13019:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8d0d9ddecd28) has no exports 00000020:00000080:3.0:1788582137.179668:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d0dbbc4f800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788582137.179675:0:38:0:(genops.c:885:class_export_put()) final put ffff8d0dac37c000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788582137.179679:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dac37c000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788582137.179685:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788582137.179747:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0d945ad800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788582137.244872:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788582137.244887:0:13019:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1788582137.244893:0:13019:0:(genops.c:885:class_export_put()) final put ffff8d0d945a9000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1788582137.244897:0:13019:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0d945a9000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788582137.244905:0:13019:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1788582137.245017:0:13019:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d0d945af800 00000020:01000000:1.0:1788582137.245037:0:13019:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:1.0:1788582137.245041:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788582137.245045:0:13019:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788582137.245049:0:13019:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8d0d91a119b8) has no exports 00000100:00100000:1.0:1788582137.245124:0:10137:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff8d0dbf8d0200:10137] 4 exiting: rc = 0 00000100:00100000:2.0:1788582137.245582:0:5845:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8d0d87222800:5845] 2 exiting: rc = 0 00000100:00100000:2.0:1788582137.246345:0:5843:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8d0da3398600:5843] 0 exiting: rc = 1 00000100:00100000:2.0:1788582137.246411:0:10136:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8d0dab9e1000:10136] 3 exiting: rc = 0 00000100:00100000:0.0:1788582137.250155:0:5844:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8d0d87221800:5844] 1 exiting: rc = 0 00000100:00100000:1.0:1788582137.250621:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250629:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250635:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250654:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250660:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250665:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250671:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250677:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250682:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250688:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250694:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250699:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250705:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250710:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250717:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250723:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250728:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250733:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250738:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250743:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250748:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250754:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250760:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250775:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250781:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250787:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250792:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250798:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250802:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250807:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250812:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250818:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250823:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250829:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250834:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250839:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250844:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250849:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250863:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250869:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250875:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250881:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250886:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250892:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250898:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250903:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250909:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250915:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250921:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250926:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250932:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250937:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.250941:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.251261:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.251282:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.251290:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.251296:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.251302:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.251309:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.251315:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.251320:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.251325:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.251331:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.251337:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.263467:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8d0d87223a00:5847] 1 exiting: rc = 0 00000100:00100000:1.0:1788582137.264570:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8d0d87221200:5846] 0 exiting: rc = 1 00000100:00100000:1.0:1788582137.264669:0:10138:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff8d0dbf444600:10138] 2 exiting: rc = 0 00000100:00100000:2.0:1788582137.265068:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265093:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265100:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265108:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265114:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265119:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265136:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265145:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265155:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265161:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265167:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265174:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265180:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265185:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265191:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265195:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265216:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265224:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265229:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265235:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265241:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265246:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265251:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265256:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265262:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265266:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265281:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265287:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265292:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265298:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265303:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265309:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265313:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265318:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265323:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265327:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265339:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265344:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265349:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265354:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265359:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265364:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265369:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265375:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265380:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265385:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265391:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265396:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265400:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265406:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265412:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265417:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265423:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265427:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265433:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265439:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265444:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265448:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265454:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265460:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265465:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265471:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265476:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.265481:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582137.269230:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8d0d92365c00:5848] 0 exiting: rc = 1 00000100:00100000:1.0:1788582137.271476:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8d0d84f9c200:5849] 1 exiting: rc = 0 00000100:00100000:3.0:1788582137.271688:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271700:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271708:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271715:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271721:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271727:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271733:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271738:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271744:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271753:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271760:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271765:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271804:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271814:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271822:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271827:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271833:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271839:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271846:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271852:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271858:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271866:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271872:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271879:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271901:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271908:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271914:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271920:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271926:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271933:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271939:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271945:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271951:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271957:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271963:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271969:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271990:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.271997:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272003:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272009:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272015:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272021:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272026:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272032:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272038:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272044:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272050:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272064:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272084:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272091:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272096:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272102:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272108:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272114:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272119:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272124:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272130:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272136:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272142:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272147:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272168:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272175:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272181:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.272187:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.285689:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8d0d84f9d000:5850] 0 exiting: rc = 1 00000100:00100000:2.0:1788582137.286163:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8d0d84f9dc00:5851] 1 exiting: rc = 0 00000100:00100000:3.0:1788582137.286308:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286316:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286322:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286327:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286333:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286338:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286343:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286349:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286354:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286359:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286365:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286562:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286572:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286577:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286582:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286587:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286591:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286596:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286618:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286622:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286627:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286632:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286637:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286642:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286647:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286651:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286656:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286661:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286666:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286671:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286676:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286681:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286686:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286691:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286697:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286702:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286708:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286713:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286718:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286723:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286729:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286735:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286740:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286745:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286750:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286755:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286760:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286765:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286770:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286775:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286780:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286785:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286790:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286803:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286807:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286812:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286817:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286821:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286826:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286830:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286835:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286840:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286845:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582137.286851:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.288808:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8d0d84f9da00:5852] 0 exiting: rc = 1 00000100:00100000:2.0:1788582137.292403:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8d0d84f9d200:5853] 1 exiting: rc = 0 00000100:00100000:1.0:1788582137.292588:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292597:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292602:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292625:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292630:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292635:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292640:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292644:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292650:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292656:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292661:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292666:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292672:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292677:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292683:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292688:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292693:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292698:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292703:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292707:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292712:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292716:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292721:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292725:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292730:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292735:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292740:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292745:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292749:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292754:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292759:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292763:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292768:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292773:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292778:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292783:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292788:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292793:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292809:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292813:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292818:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292823:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292828:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292834:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292839:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292844:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292849:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292853:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292859:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292863:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292868:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292873:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292879:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292884:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292889:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292894:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292898:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292902:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292908:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292913:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292918:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292924:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292929:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.292935:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.293344:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8d0d84f9d400:5855] 1 exiting: rc = 0 00000100:00100000:2.0:1788582137.293693:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8d0d84f9ca00:5854] 0 exiting: rc = 1 00000100:00100000:1.0:1788582137.294332:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294340:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294346:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294351:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294357:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294363:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294368:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294385:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294400:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294406:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294411:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294416:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294421:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294426:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294431:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294436:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294441:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294446:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294451:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294456:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294461:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294465:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294470:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294475:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294480:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294485:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294490:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294494:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294499:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294503:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294509:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294513:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294518:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294523:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294528:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294532:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294537:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294541:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294546:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294551:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294556:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294560:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294565:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294574:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294579:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294584:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294589:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294594:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294599:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294604:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294609:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294613:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294618:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294623:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294628:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294632:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294637:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294642:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294647:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294651:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294656:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294661:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294666:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.294672:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.295163:0:5858:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8d0db7702400:5858] 2 exiting: rc = 0 00000100:00100000:3.0:1788582137.295512:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8d0d84f84400:5856] 0 exiting: rc = 1 00000100:00100000:2.0:1788582137.295892:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8d0d85bb4200:5857] 1 exiting: rc = 0 00000100:00100000:1.0:1788582137.297181:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297190:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297196:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297215:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297222:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297228:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297233:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297239:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297244:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297250:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297285:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297292:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297298:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297313:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297319:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297325:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297330:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297337:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297343:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297348:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297353:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297359:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297365:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297370:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297375:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297381:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297387:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297392:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297399:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297404:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297410:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297416:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297421:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297427:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297446:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297452:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297458:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297464:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297470:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297476:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297482:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297488:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297495:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297500:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297506:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297512:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297517:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297523:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297533:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297538:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297547:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297553:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297559:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297566:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297574:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297581:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297586:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297592:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297599:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297604:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297609:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297615:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297621:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788582137.297633:0:13019:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1788582137.308930:0:13019:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788582137.308943:0:13019:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1788582137.308949:0:13019:0:(genops.c:885:class_export_put()) final put ffff8d0d920f7800/MDS_uuid 00000020:00000080:1.0:1788582137.308955:0:13019:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0d920f7800/MDS_uuid for MDS 00000020:01000000:1.0:1788582137.308963:0:13019:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1788582137.309114:0:13019:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000100:00100000:1.0:1788582137.327572:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020901120:0@lo:400:kworker.0 00000400:00000100:1.0:1788582137.327621:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875464020901120 offset 0 length 224: 4 00000100:00100000:1.0:1788582137.329042:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020901248:0@lo:400:kworker.0 00000400:00000100:1.0:1788582137.329086:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875464020901248 offset 0 length 224: 4 00000100:00100000:1.0:1788582137.329130:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788582137.329334:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020901376:0@lo:400:kworker.0 00000400:00000100:1.0:1788582137.329359:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875464020901376 offset 0 length 224: 4 00010000:00010000:2.0:1788582137.585835:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582138.621406:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788582139.447638:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788582139.447650:0:6716:0:(genops.c:885:class_export_put()) final put ffff8d0c8302e000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788582139.447683:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0c8302e000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1788582139.447723:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d0c83028800 for lustre-OST0000 00010000:00010000:1.0:1788582139.631327:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788582140.237818:0:13172:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788582140.265603:0:13172:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788582140.265650:0:13172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fc00/0x2bc3aa892c3a6bc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6bca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582140.265664:0:13172:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fc00/0x2bc3aa892c3a6bc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6bca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582140.265672:0:13172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fc00/0x2bc3aa892c3a6bc3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bc3aa892c3a6bca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582140.265679:0:13172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fc00/0x2bc3aa892c3a6bc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bc3aa892c3a6bca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582140.265700:0:13172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788582140.265705:0:13172:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788582140.265725:0:13172:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788582140.265736:0:13172:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d0dbbdc1880 x1875464020901248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788582153 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582140.265751:0:13172:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00100000:1.0:1788582140.265786:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020901248:0@lo:400:kworker.0 00000100:00080000:1.0:1788582140.265816:0:13172:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788582140.265837:0:13172:0:(import.c:65:import_set_state_nolock()) ffff8d0dbf7b1800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788582140.265898:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875464020901504:0@lo:39:umount.0 00000400:00000100:1.0:1788582140.265946:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875464020901504 offset 0 length 224: 4 00010000:00010000:2.0:1788582140.269687:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582140.269699:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fc00/0x2bc3aa892c3a6bc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bc3aa892c3a6bca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582140.269710:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8138fc00 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:2.0:1788582140.269715:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fc00/0x2bc3aa892c3a6bc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bc3aa892c3a6bca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582140.269726:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fc00/0x2bc3aa892c3a6bc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bc3aa892c3a6bca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788582140.269732:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fc00/0x2bc3aa892c3a6bc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bc3aa892c3a6bca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788582140.269738:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788582140.269740:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788582140.269743:0:5832:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788582140.269784:0:5832:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fc00/0x2bc3aa892c3a6bc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bc3aa892c3a6bca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582140.269790:0:5832:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788582140.269813:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fc00/0x2bc3aa892c3a6bc3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bc3aa892c3a6bca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582140.269820:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fc00/0x2bc3aa892c3a6bc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x2bc3aa892c3a6bca expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582140.269830:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582140.269832:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582140.269834:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582140.269851:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020901632:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788582140.269933:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582140.269998:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020901632 00000100:00100000:2.0:1788582140.270005:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020901632 00000100:00100000:2.0:1788582140.270043:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788582140.270050:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaeaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1875464020901632:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788582140.270057:0:5829:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788582140 with bad export cookie 3153551670218746014 00000100:00100000:2.0:1788582140.301163:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaeaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3308:x1875464020901632:12345-0@lo:103:ldlm_bl.0 Request processed in 31102us (31228us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788582140.301178:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788582140.301227:0:3308:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.112@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788582140.301233:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d0da7185800 MGS: changing import state from FULL to DISCONN 00000100:02020000:3.0:1788582140.301237:0:3308:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.112@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788582140.314447:0:3308:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.112@tcp not replayable, auto-deactivating 00000100:00080000:3.0:1788582140.314453:0:3308:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788582140.314462:0:3308:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d0dbbdc0a80 x1875464020901120/t0(0) o400->MGC192.168.201.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788582153 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788582140.314487:0:3308:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d0dbaea9c00 x1875464020901632/t0(0) o103->MGC192.168.201.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788582156 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788582140.314496:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788582140.314498:0:3308:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788582140.314500:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788582140.314503:0:3308:0:(import.c:65:import_set_state_nolock()) ffff8d0da7185800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788582140.314508:0:3308:0:(import.c:510:import_select_connection()) MGC192.168.201.112@tcp: connect to NID 0@lo last attempt 145 00000100:00080000:3.0:1788582140.314515:0:3308:0:(import.c:624:import_select_connection()) MGC192.168.201.112@tcp: import ffff8d0da7185800 using connection 192.168.201.112@tcp/0@lo 00000100:00100000:2.0:1788582140.314541:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3309:1875464020901120:0@lo:400:kworker.0 00000100:00100000:3.0:1788582140.314560:0:3308:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0dac0c0e00 x1875464020901760/t0(0) o250->MGC192.168.201.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788582140.314589:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3308:1875464020901632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788582140.314657:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3305:1875464020901760:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:1.0:1788582140.314708:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875464020901760 offset 0 length 520: 4 00010000:00010000:0.0:1788582140.653534:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788582141.006172:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788582141.006180:0:7648:0:(genops.c:885:class_export_put()) final put ffff8d0dbfa10000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788582141.006479:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dbfa10000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788582141.006787:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d0dbfa12800 for lustre-OST0001 00010000:00010000:1.0:1788582141.677386:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788582142.445458:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 440dcdbb-2cf9-4bb9-89ca-da9aec3e214b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788582142.445470:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 440dcdbb-2cf9-4bb9-89ca-da9aec3e214b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788582142.445595:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788582142.445628:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020901888:0@lo:400:kworker.0 00000400:00000100:3.0:1788582142.445687:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875464020901888 offset 0 length 224: 4 00010000:00010000:2.0:1788582142.701420:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582143.728575:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582144.751840:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788582145.453819:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 440dcdbb-2cf9-4bb9-89ca-da9aec3e214b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788582145.453847:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 440dcdbb-2cf9-4bb9-89ca-da9aec3e214b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788582145.453928:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788582145.453950:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875464020902016:0@lo:400:kworker.0 00000400:00000100:0.0:1788582145.454009:0:3307:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875464020902016 offset 0 length 224: 4 00010000:00010000:2.0:1788582145.773361:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582146.798900:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582147.821475:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582148.845352:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582149.870822:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788582150.637315:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 440dcdbb-2cf9-4bb9-89ca-da9aec3e214b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788582150.637326:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 440dcdbb-2cf9-4bb9-89ca-da9aec3e214b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788582150.637420:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788582150.637450:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020902144:0@lo:400:kworker.0 00000400:00000100:3.0:1788582150.637510:0:3306:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875464020902144 offset 0 length 224: 4 00000100:00100000:2.0:1788582150.641905:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788582140/real 1788582140] req@ffff8d0dac0c0e00 x1875464020901760/t0(0) o250->MGC192.168.201.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788582150 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582150.641939:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d0dac0c0e00 x1875464020901760/t0(0) o250->MGC192.168.201.112@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788582150 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582150.641948:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788582140/real 1788582140] req@ffff8d0dbbdc1880 x1875464020901504/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788582150 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582150.641959:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d0dbbdc1880 x1875464020901504/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788582150 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788582150.641974:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0da7185800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788582150.641994:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788582150.641998:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3305:1875464020901760:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:2.0:1788582150.642003:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0dbf7b1800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788582150.642030:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875464020901504:0@lo:39:umount.0 00000100:00080000:1.0:1788582150.642063:0:13172:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788582150.642069:0:13172:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00080000:0.0:1788582150.642144:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 440dcdbb-2cf9-4bb9-89ca-da9aec3e214b->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788582150.642149:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788582150.642153:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d0da7185800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788582150.642158:0:8:0:(import.c:510:import_select_connection()) MGC192.168.201.112@tcp: connect to NID 0@lo last attempt 359 00000100:00080000:0.0:1788582150.642164:0:8:0:(import.c:589:import_select_connection()) MGC192.168.201.112@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788582150.642170:0:8:0:(import.c:624:import_select_connection()) MGC192.168.201.112@tcp: import ffff8d0da7185800 using connection 192.168.201.112@tcp/0@lo 00000100:00100000:0.0:1788582150.642220:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0dbf376680 x1875464020902272/t0(0) o250->MGC192.168.201.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788582150.649032:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3305:1875464020902272:0@lo:250:kworker.0 00000400:00000100:2.0:1788582150.649797:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875464020902272 offset 0 length 520: 4 00000100:00100000:1.0:1788582150.650745:0:13172:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788582150.652783:0:13172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7089400/0x2bc3aa892c3a6bd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6bd8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582150.652801:0:13172:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7089400/0x2bc3aa892c3a6bd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6bd8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582150.652807:0:13172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7089400/0x2bc3aa892c3a6bd1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bc3aa892c3a6bd8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582150.652813:0:13172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.112@tcp lock: ffff8d0da7089400/0x2bc3aa892c3a6bd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bc3aa892c3a6bd8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582150.652844:0:13172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788582150.652852:0:13172:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04400/0x2bc3aa892c3a6dfa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6e01 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582150.652857:0:13172:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04400/0x2bc3aa892c3a6dfa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6e01 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582150.652862:0:13172:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04400/0x2bc3aa892c3a6dfa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bc3aa892c3a6e01 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582150.652882:0:13172:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04400/0x2bc3aa892c3a6dfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bc3aa892c3a6e01 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582150.652902:0:13172:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788582150.652907:0:13172:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00010000:00010000:0.0:1788582150.652926:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000020:01000004:1.0:1788582150.652929:0:13172:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788582150.652934:0:13172:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00010000:00010000:0.0:1788582150.652936:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0da7089400/0x2bc3aa892c3a6bd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bc3aa892c3a6bd8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1788582150.652939:0:13172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788582150.652947:0:13172:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00010000:00010000:0.0:1788582150.652948:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089400 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:0.0:1788582150.652954:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0da7089400/0x2bc3aa892c3a6bd1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bc3aa892c3a6bd8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582150.652963:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0da7089400/0x2bc3aa892c3a6bd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bc3aa892c3a6bd8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788582150.652981:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0da7089400/0x2bc3aa892c3a6bd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bc3aa892c3a6bd8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788582150.652987:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788582150.652989:0:7637:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788582150.652991:0:7637:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788582150.653004:0:7637:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d0da7185800 00010000:00010000:0.0:1788582150.653008:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0da7089400/0x2bc3aa892c3a6bd1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bc3aa892c3a6bd8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582150.653014:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0da7089400/0x2bc3aa892c3a6bd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bc3aa892c3a6bd8 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582150.653027:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788582150.653030:0:7637:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04400/0x2bc3aa892c3a6dfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bc3aa892c3a6e01 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582150.653036:0:7637:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04400 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:0.0:1788582150.653039:0:7637:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04400/0x2bc3aa892c3a6dfa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bc3aa892c3a6e01 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582150.653056:0:7637:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04400/0x2bc3aa892c3a6dfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bc3aa892c3a6e01 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788582150.653063:0:7637:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04400/0x2bc3aa892c3a6dfa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bc3aa892c3a6e01 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788582150.653068:0:7637:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788582150.653070:0:7637:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788582150.653075:0:7637:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788582150.653081:0:7637:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d0da7185800 00000020:00080000:1.0:1788582150.653083:0:13172:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8d0dbf4e3370) has no exports 00010000:00010000:0.0:1788582150.653085:0:7637:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04400/0x2bc3aa892c3a6dfa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bc3aa892c3a6e01 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582150.653095:0:7637:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04400/0x2bc3aa892c3a6dfa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bc3aa892c3a6e01 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788582150.653116:0:13172:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff8d0dbf4e3370) has no exports 00010000:00010000:0.0:1788582150.653118:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582150.653122:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582150.653124:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582150.653581:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788582150.663884:0:13172:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d0dab4638a0 - data ffff8d0dbfe7ed80/ffff8d0dbf4a8400 00000020:01000000:1.0:1788582150.664465:0:13172:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d0dbfa1eea0 - data ffff8d0db11aa288/ffff8d0d90dbe400 00100000:10000000:3.0:1788582150.675235:0:13172:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788582150.726927:0:13172:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a69d2 00000020:00000080:1.0:1788582150.726938:0:13172:0:(genops.c:885:class_export_put()) final put ffff8d0dbf4e8000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788582150.726964:0:13172:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d0dac39a800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788582150.726968:0:13172:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0dac39a800 2 00000020:01000004:1.0:1788582150.726971:0:13172:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d0dac39a800 from lustre-OST0000 00000020:00000080:1.0:1788582150.726995:0:13172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788582150.727004:0:13172:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788582150.727007:0:13172:0:(genops.c:885:class_export_put()) final put ffff8d0dbf4ed800/lustre-OST0000_UUID 00000020:00000080:1.0:1788582150.727009:0:13172:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dbf4ed800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788582150.727017:0:13172:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788582150.727066:0:13172:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788582150.727071:0:13172:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788582150.727075:0:13172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788582150.727080:0:13172:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788582150.727087:0:13172:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d0dbf7b0000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788582150.727093:0:13172:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff8d0dbf753370) has exports, disconnecting them 00000020:00080000:1.0:1788582150.727121:0:13172:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d0dbf7b0000), last request at 1788581943 00000020:00000080:1.0:1788582150.727125:0:13172:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a69fc 00000020:00080000:1.0:1788582150.727279:0:13172:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d0dbf7b0000): rc 0 00000020:00000080:1.0:1788582150.727284:0:13172:0:(genops.c:885:class_export_put()) final put ffff8d0dbf7b0000/lustre-MDT0000-lwp-OST0000 00010000:01000000:1.0:1788582150.727829:0:13172:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:1.0:1788582150.727833:0:13172:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788582150.727838:0:13172:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788582150.727844:0:13172:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788582150.727965:0:13172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788582150.727970:0:13172:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:1.0:1788582150.727974:0:13172:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0dac39a800 1 00000020:00000080:1.0:1788582150.727978:0:13172:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a698c 00000020:00000080:1.0:1788582150.727983:0:13172:0:(genops.c:885:class_export_put()) final put ffff8d0dbbc49800/lustre-OST0000-osd_UUID 00000020:01000000:1.0:1788582150.727987:0:13172:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:1.0:1788582150.727991:0:13172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788582150.727994:0:13172:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788582150.727996:0:13172:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8d0d9dde99b8) has no exports 00000020:00000080:2.0:1788582150.728118:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dbf4e8000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788582150.728148:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dbf7b0000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788582150.728155:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d0dbf7b1800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788582150.728159:0:8:0:(genops.c:885:class_export_put()) final put ffff8d0dabc22800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788582150.728162:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dabc22800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788582150.728165:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788582150.728217:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dbbc49800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1788582150.791585:0:13172:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788582150.791602:0:13172:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1788582150.791607:0:13172:0:(genops.c:885:class_export_put()) final put ffff8d0d920f5800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1788582150.791612:0:13172:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0d920f5800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1788582150.791619:0:13172:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1788582150.791746:0:13172:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d0dac39b000 00000020:02000400:1.0:1788582150.791791:0:13172:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1788582150.896086:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582151.919827:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582152.941689:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788582153.325984:0:13326:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788582153.341634:0:13326:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1788582153.341716:0:13326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6ba7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6bae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582153.341731:0:13326:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6ba7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6bae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582153.341751:0:13326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6ba7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bc3aa892c3a6bae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582153.341758:0:13326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bc3aa892c3a6bae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582153.341782:0:13326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788582153.341788:0:13326:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788582153.342236:0:13326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788582153.342249:0:13326:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d0dbbdc3b80 x1875464020901376/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788582153 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582153.342278:0:13326:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d0dbbdc0700 x1875464020901888/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788582158 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582153.342289:0:13326:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d0dbf376300 x1875464020902016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788582161 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582153.342300:0:13326:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d0dbf374380 x1875464020902144/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788582166 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582153.342307:0:13326:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00100000:1.0:1788582153.342339:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020902144:0@lo:400:kworker.0 00000100:00100000:1.0:1788582153.342358:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020901376:0@lo:400:kworker.0 00000100:00100000:1.0:1788582153.342407:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf376300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875464020902016:0@lo:400:kworker.0 00000100:00100000:2.0:1788582153.342531:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020901888:0@lo:400:kworker.0 00000100:00080000:1.0:1788582153.342780:0:13326:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788582153.342807:0:13326:0:(import.c:65:import_set_state_nolock()) ffff8d0dabc24800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788582153.342887:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788582153.342894:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bc3aa892c3a6bae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582153.342902:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8138ea00 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:0.0:1788582153.342906:0:5831:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6ba7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bc3aa892c3a6bae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582153.342916:0:5831:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bc3aa892c3a6bae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788582153.342924:0:5831:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6ba7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bc3aa892c3a6bae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788582153.342930:0:5831:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788582153.342932:0:5831:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788582153.342934:0:5831:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788582153.342948:0:5831:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d0da7185800 00010000:00010000:0.0:1788582153.342952:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6ba7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bc3aa892c3a6bae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582153.343095:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d8138ea00/0x2bc3aa892c3a6ba7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bc3aa892c3a6bae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582153.343110:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582153.343112:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582153.343114:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582153.343163:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875464020902400:0@lo:39:umount.0 00000400:00000100:2.0:1788582153.343242:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875464020902400 offset 0 length 224: 4 00010000:00010000:1.0:1788582153.969528:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582154.989675:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788582155.760078:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 440dcdbb-2cf9-4bb9-89ca-da9aec3e214b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788582155.760089:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 440dcdbb-2cf9-4bb9-89ca-da9aec3e214b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788582156.013458:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582157.045087:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582158.061392:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582159.086565:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582160.109471:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788582160.887752:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 440dcdbb-2cf9-4bb9-89ca-da9aec3e214b->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788582160.887763:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 440dcdbb-2cf9-4bb9-89ca-da9aec3e214b->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788582161.133366:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582162.157442:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582163.182081:0:7637:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582163.565341:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788582153/real 1788582153] req@ffff8d0dbbdc3b80 x1875464020902400/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788582163 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582163.565376:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d0dbbdc3b80 x1875464020902400/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788582163 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788582163.565396:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0dabc24800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1788582163.565423:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875464020902400:0@lo:39:umount.0 00000100:00080000:2.0:1788582163.565464:0:13326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788582163.565469:0:13326:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788582163.565474:0:13326:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788582163.568649:0:13326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27e00/0x2bc3aa892c3a6bb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6bbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582163.568689:0:13326:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27e00/0x2bc3aa892c3a6bb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6bbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582163.568696:0:13326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27e00/0x2bc3aa892c3a6bb5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bc3aa892c3a6bbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582163.568703:0:13326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27e00/0x2bc3aa892c3a6bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bc3aa892c3a6bbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582163.568799:0:13326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788582163.568807:0:13326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7089a00/0x2bc3aa892c3a6dec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a6df3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582163.568814:0:13326:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7089a00/0x2bc3aa892c3a6dec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a6df3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582163.568829:0:13326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7089a00/0x2bc3aa892c3a6dec lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bc3aa892c3a6df3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582163.568836:0:13326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.112@tcp lock: ffff8d0da7089a00/0x2bc3aa892c3a6dec lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x2bc3aa892c3a6df3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582163.571596:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788582163.571611:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27e00/0x2bc3aa892c3a6bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bc3aa892c3a6bbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582163.571623:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27e00 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:0.0:1788582163.571628:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27e00/0x2bc3aa892c3a6bb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bc3aa892c3a6bbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582163.571638:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27e00/0x2bc3aa892c3a6bb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bc3aa892c3a6bbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788582163.571646:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27e00/0x2bc3aa892c3a6bb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bc3aa892c3a6bbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788582163.571652:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788582163.571654:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1788582163.571668:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d0da7185800 00010000:00010000:0.0:1788582163.571672:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27e00/0x2bc3aa892c3a6bb5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bc3aa892c3a6bbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582163.571700:0:5832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27e00/0x2bc3aa892c3a6bb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bc3aa892c3a6bbc expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582163.571720:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788582163.571724:0:5832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0da7089a00/0x2bc3aa892c3a6dec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bc3aa892c3a6df3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582163.571730:0:5832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089a00 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:0.0:1788582163.571733:0:5832:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0da7089a00/0x2bc3aa892c3a6dec lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x2bc3aa892c3a6df3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582163.571741:0:5832:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0da7089a00/0x2bc3aa892c3a6dec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bc3aa892c3a6df3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788582163.571748:0:5832:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0da7089a00/0x2bc3aa892c3a6dec lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bc3aa892c3a6df3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788582163.571754:0:5832:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788582163.571757:0:5832:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1788582163.571761:0:5832:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d0da7185800 00010000:00010000:0.0:1788582163.571764:0:5832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0da7089a00/0x2bc3aa892c3a6dec lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bc3aa892c3a6df3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582163.571772:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582163.571774:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582163.571776:0:5832:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582163.571920:0:13326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788582163.571928:0:13326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0da7089a00/0x2bc3aa892c3a6dec lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bc3aa892c3a6df3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788582163.571944:0:13326:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:2.0:1788582163.571951:0:13326:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:2.0:1788582163.571955:0:13326:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788582163.571992:0:13326:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788582163.571997:0:13326:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788582163.572002:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788582163.572008:0:13326:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788582163.572012:0:13326:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8d0dbfb44d28) has no exports 00000020:00080000:2.0:1788582163.572035:0:13326:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8d0dbfb44d28) has no exports 00010000:00010000:0.0:1788582163.573617:0:5831:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788582163.578152:0:13326:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d0d90faef60 - data ffff8d0db139a5e8/ffff8d0d85a35000 00000020:01000000:2.0:1788582163.578431:0:13326:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d0dab4602a0 - data ffff8d0db13825e8/ffff8d0db7f05800 00100000:10000000:2.0:1788582163.589241:0:13326:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788582163.617304:0:13326:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6a9d 00000020:00000080:0.0:1788582163.617314:0:13326:0:(genops.c:885:class_export_put()) final put ffff8d0dae9d5800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788582163.617342:0:13326:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d0dbf4ee800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788582163.617345:0:13326:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0dbf4ee800 2 00000020:01000004:0.0:1788582163.617348:0:13326:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d0dbf4ee800 from lustre-OST0001 00000020:00000080:0.0:1788582163.617373:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788582163.617382:0:13326:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788582163.617385:0:13326:0:(genops.c:885:class_export_put()) final put ffff8d0da78bf000/lustre-OST0001_UUID 00000020:00000080:0.0:1788582163.617389:0:13326:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0da78bf000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788582163.617398:0:13326:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788582163.617515:0:13326:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 440dcdbb-2cf9-4bb9-89ca-da9aec3e214b->MGS 00010000:00010000:0.0:1788582163.617531:0:13326:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d8138e400/0x2bc3aa892c3a69af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bc3aa892c3a69b6 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788582163.617544:0:13326:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d8138e400/0x2bc3aa892c3a69af lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bc3aa892c3a69b6 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788582163.617551:0:13326:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788582163.617554:0:13326:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788582163.617557:0:13326:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788582163.617570:0:13326:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d0da7185800 00010000:00010000:0.0:1788582163.617574:0:13326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d8138e400/0x2bc3aa892c3a69af lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bc3aa892c3a69b6 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582163.617588:0:13326:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26e00/0x2bc3aa892c3a6bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x2bc3aa892c3a6c02 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788582163.617596:0:13326:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26e00/0x2bc3aa892c3a6bfb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x2bc3aa892c3a6c02 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788582163.617601:0:13326:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788582163.617604:0:13326:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788582163.617605:0:13326:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788582163.617613:0:13326:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d0da7185800 00010000:00010000:0.0:1788582163.617622:0:13326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26e00/0x2bc3aa892c3a6bfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x2bc3aa892c3a6c02 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788582163.617638:0:13326:0:(import.c:65:import_set_state_nolock()) ffff8d0da7185800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788582163.617642:0:13326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788582163.617644:0:13326:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788582163.617646:0:13326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788582163.617649:0:13326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788582163.617659:0:13326:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d0dbf376680 x1875464020902272/t0(0) o250->MGC192.168.201.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788582165 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788582163.617681:0:13326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788582163.617683:0:13326:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000020:00000080:2.0:1788582163.617816:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dae9d5800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1788582163.618725:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf376680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:440dcdbb-2cf9-4bb9-89ca-da9aec3e214b:3305:1875464020902272:0@lo:250:kworker.0 10000000:01000000:0.0:1788582163.620406:0:13326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788582163.620423:0:13326:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6890 00000020:00000080:0.0:1788582163.620432:0:13326:0:(genops.c:885:class_export_put()) final put ffff8d0d920f4800/440dcdbb-2cf9-4bb9-89ca-da9aec3e214b 00000020:01000000:0.0:1788582163.620454:0:13326:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.201.112@tcp (flags='') 00000020:00000080:0.0:1788582163.620462:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788582163.620470:0:13326:0:(obd_config.c:956:class_cleanup()) MGC192.168.201.112@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788582163.620474:0:13326:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8d0d9dde8000) has no exports 00000020:00000080:2.0:1788582163.620529:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0d920f4800/440dcdbb-2cf9-4bb9-89ca-da9aec3e214b for MGC192.168.201.112@tcp 10000000:01000000:3.0:1788582163.620592:0:5840:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788582163.620682:0:13326:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.201.112@tcp: client import never connected 00000100:00080000:0.0:1788582163.620687:0:13326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788582163.620690:0:13326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788582163.620693:0:13326:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788582163.620696:0:13326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788582163.620739:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788582163.620746:0:13326:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.112@tcp (uuid 440dcdbb-2cf9-4bb9-89ca-da9aec3e214b) 00000020:01000000:0.0:1788582163.620752:0:13326:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788582163.620756:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788582163.620760:0:13326:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788582163.620766:0:13326:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8d0dabc24000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788582163.620771:0:13326:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff8d0d97e9cd28) has exports, disconnecting them 00000020:00080000:0.0:1788582163.620776:0:13326:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8d0dabc24000), last request at 1788581959 00000020:00000080:0.0:1788582163.620793:0:13326:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6ac7 00000020:00080000:0.0:1788582163.620805:0:13326:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d0dabc24000): rc 0 00000020:00000080:0.0:1788582163.620808:0:13326:0:(genops.c:885:class_export_put()) final put ffff8d0dabc24000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1788582163.621306:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d0da7185800 for MGC192.168.201.112@tcp 00000020:00000080:2.0:1788582163.621313:0:38:0:(genops.c:885:class_export_put()) final put ffff8d0da7181000/440dcdbb-2cf9-4bb9-89ca-da9aec3e214b 00000020:00000080:2.0:1788582163.621315:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0da7181000/440dcdbb-2cf9-4bb9-89ca-da9aec3e214b for MGC192.168.201.112@tcp 00000020:01000000:2.0:1788582163.621321:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.112@tcp (440dcdbb-2cf9-4bb9-89ca-da9aec3e214b) 00000020:00000080:2.0:1788582163.621537:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dabc24000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788582163.626444:0:13326:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788582163.626453:0:13326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788582163.626457:0:13326:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788582163.626465:0:13326:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788582163.626564:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d0dabc24800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788582163.629472:0:7637:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788582163.629737:0:5832:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788582163.629874:0:5831:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788582163.630040:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8d0d9152aa00:5826] 0 exiting: rc = 1 00000100:00100000:1.0:1788582163.636057:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8d0d8881fe00:5827] 1 exiting: rc = 0 00000100:00100000:2.0:1788582163.636397:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.636654:0:5829:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8d0d8881fa00:5829] 1 exiting: rc = 0 00000100:00100000:3.0:1788582163.636750:0:5830:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8d0da98e1000:5830] 2 exiting: rc = 0 00000100:00100000:3.0:1788582163.636802:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8d0d8881f200:5828] 0 exiting: rc = 1 00000100:00100000:2.0:1788582163.639424:0:7636:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8d0dac11ca00:7636] 3 exiting: rc = 0 00000100:00100000:3.0:1788582163.639569:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639578:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639584:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639591:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639597:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639604:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639611:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639616:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639641:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639648:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639654:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639660:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639666:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639672:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639678:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639684:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639692:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639698:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639704:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639709:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639714:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639721:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639726:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639732:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639737:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639743:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639749:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639756:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639762:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639767:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639772:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639779:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639785:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639790:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639796:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639802:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639808:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639813:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639818:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639839:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639844:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639849:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639853:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639867:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639872:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639877:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639882:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639887:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639892:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639896:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639901:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639908:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639913:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639918:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639923:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639928:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639932:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639937:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639942:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639947:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639952:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639957:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639964:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.639969:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788582163.651500:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788582163.651512:0:13326:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788582163.651519:0:13326:0:(genops.c:885:class_export_put()) final put ffff8d0dbae3e000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788582163.651524:0:13326:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dbae3e000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788582163.651535:0:13326:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788582163.651589:0:13326:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0dbf4ee800 1 00000020:00000080:3.0:1788582163.651595:0:13326:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x2bc3aa892c3a6a6c 00000020:00000080:3.0:1788582163.651602:0:13326:0:(genops.c:885:class_export_put()) final put ffff8d0dab597000/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788582163.651616:0:13326:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788582163.651620:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788582163.651625:0:13326:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788582163.651629:0:13326:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8d0dbf4e19b8) has no exports 00000020:00000080:2.0:1788582163.652133:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dab597000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788582163.683238:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788582163.683255:0:13326:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788582163.683261:0:13326:0:(genops.c:885:class_export_put()) final put ffff8d0dbf4ea000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788582163.683276:0:13326:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dbf4ea000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788582163.683289:0:13326:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788582163.683547:0:13326:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d0dbf4ee000 00000020:01000000:2.0:1788582163.683571:0:13326:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788582163.683576:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788582163.683580:0:13326:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788582163.683584:0:13326:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8d0d97e999b8) has no exports 00000020:00000080:2.0:1788582163.683614:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788582163.683623:0:13326:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788582163.683626:0:13326:0:(genops.c:885:class_export_put()) final put ffff8d0dbbc4b800/OSS_uuid 00000020:00000080:2.0:1788582163.683628:0:13326:0:(genops.c:844:class_export_destroy()) destroying export ffff8d0dbbc4b800/OSS_uuid for OSS 00000020:01000000:2.0:1788582163.683635:0:13326:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1788582163.683657:0:5839:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788582163.684337:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8d0da7090000:6693] 2 exiting: rc = 0 00000100:00100000:2.0:1788582163.684411:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8d0da7090200:6692] 1 exiting: rc = 0 00000100:00100000:2.0:1788582163.684473:0:8034:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8d0dbf4b6e00:8034] 3 exiting: rc = 0 00000100:00100000:2.0:1788582163.684541:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8d0da7091e00:6691] 0 exiting: rc = 1 00000100:00100000:2.0:1788582163.684617:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684632:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684642:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684652:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684660:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684670:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684679:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684689:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684698:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684708:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684717:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684726:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684736:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684746:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684755:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684764:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684773:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684792:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684801:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684811:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684830:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684839:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684849:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684858:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684866:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684874:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684882:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684891:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684899:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684908:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.684916:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685296:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685307:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685317:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685326:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685336:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685344:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685354:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685363:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685371:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685381:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685391:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685401:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685411:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685420:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685430:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685439:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685448:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685457:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685467:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685475:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685485:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685502:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685511:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685521:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685531:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685540:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685549:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685557:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685570:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685579:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685589:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685598:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.685608:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.694977:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8d0da7091c00:6694] 0 exiting: rc = 1 00000100:00100000:2.0:1788582163.695077:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8d0dab7e5400:6695] 1 exiting: rc = 0 00000100:00100000:3.0:1788582163.695499:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695522:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695529:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695536:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695544:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695553:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695558:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695563:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695568:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695572:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695581:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695588:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695593:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695598:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695606:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695614:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695621:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695630:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695635:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695640:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695646:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695651:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695675:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695683:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695690:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695697:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695707:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695712:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695718:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695723:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695728:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695739:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695746:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695752:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695759:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695767:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695785:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695791:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695796:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695802:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695807:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695817:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695835:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695841:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695847:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695855:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695870:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695877:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695882:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695887:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695891:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695900:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695912:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695925:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695931:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695936:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695941:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695946:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695951:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695956:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695962:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695967:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695972:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788582163.695984:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.698871:0:12171:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff8d0dbad31000:12171] 3 exiting: rc = 0 00000100:00100000:3.0:1788582163.698905:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8d0d86645c00:6697] 1 exiting: rc = 0 00000100:00100000:2.0:1788582163.699276:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8d0dab7e5c00:6698] 2 exiting: rc = 0 00000100:00100000:3.0:1788582163.700682:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8d0d86645200:6696] 0 exiting: rc = 1 00000100:00100000:2.0:1788582163.700751:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.700760:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.700767:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.700773:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.700780:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.700788:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.700794:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.700801:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.700808:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.700814:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.700831:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.700839:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.700845:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.700851:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.700858:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.700864:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.700870:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.700876:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.700883:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.700902:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.700910:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701026:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701032:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701037:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701043:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701049:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701055:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701060:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701066:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701091:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701098:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701104:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701110:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701116:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701122:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701129:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701135:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701141:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701147:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701153:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701159:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701166:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701171:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701177:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701184:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701189:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701196:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701227:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701235:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701241:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701247:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701253:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701259:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701281:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701292:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701298:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701304:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701311:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701317:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701324:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701330:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701336:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701342:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.701349:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.705767:0:6699:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8d0dab7e5a00:6699] 0 exiting: rc = 1 00000100:00100000:3.0:1788582163.710166:0:6700:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8d0dab7e5200:6700] 1 exiting: rc = 0 00000100:00100000:0.0:1788582163.710331:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710340:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710347:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710354:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710360:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710366:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710372:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710378:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710384:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710389:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710395:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710401:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710407:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710412:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710418:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710423:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710428:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710433:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710439:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710444:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710450:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710455:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710461:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710468:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710474:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710480:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710486:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710491:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710496:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710515:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710521:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710527:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710532:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710537:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710543:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710548:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710554:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710559:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710565:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710570:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710576:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710581:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710585:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710590:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710595:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710600:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710605:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710610:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710615:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710620:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710625:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710630:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710636:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710641:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710646:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710651:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710656:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710661:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710666:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710671:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710676:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710681:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710686:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.710691:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788582163.711672:0:6702:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8d0dba8d4200:6702] 1 exiting: rc = 0 00000100:00100000:3.0:1788582163.711955:0:6701:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8d0dab7e4a00:6701] 0 exiting: rc = 1 00000100:00100000:0.0:1788582163.712056:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712065:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712071:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712077:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712084:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712090:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712096:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712102:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712118:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712126:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712132:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712138:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712144:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712150:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712156:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712162:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712170:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712176:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712182:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712188:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712268:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712276:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712282:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712288:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712295:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712302:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712308:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712314:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712321:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712327:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712333:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712340:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712360:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712366:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712372:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712386:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712392:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712398:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712403:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712409:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712415:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712421:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712427:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712432:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712450:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712457:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712464:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712470:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712476:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712482:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712488:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712494:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712500:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712506:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712512:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712518:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712537:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712543:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712549:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712555:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712560:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712566:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712574:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788582163.712579:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1788582163.720354:0:13326:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788582181.852805:0:13941:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg112-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788582190.380262:0:14402:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788582190.380268:0:14402:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1788582190.380465:0:14402:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d0dbbdde000 00000020:01000004:2.0:1788582190.380481:0:14402:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788582190.380488:0:14402:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1788582190.380502:0:14402:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8d0dbf4e19b8) 00000020:00000080:2.0:1788582190.380514:0:14402:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1788582190.403670:0:14402:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1788582190.413630:0:14402:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:3.0:1788582190.414437:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 411: rc = 0 00100000:10000000:3.0:1788582190.414653:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 411: rc = 0 00100000:10000000:3.0:1788582190.415034:0:14402:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1788582190.415109:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 411: rc = 0 00100000:10000000:3.0:1788582190.415403:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 411: rc = 0 00100000:10000000:3.0:1788582190.415922:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 411: rc = 0 00100000:10000000:3.0:1788582190.416113:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 411: rc = 0 00100000:10000000:3.0:1788582190.417357:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 413: rc = 0 00100000:10000000:3.0:1788582190.419542:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 449: rc = 0 00100000:10000000:3.0:1788582190.419647:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 449: rc = 0 00100000:10000000:3.0:1788582190.424158:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 458: rc = 0 00100000:10000000:3.0:1788582190.425909:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 458: rc = 0 00100000:10000000:3.0:1788582190.426769:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 458: rc = 0 00100000:10000000:2.0:1788582190.428638:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 458: rc = 0 00100000:10000000:2.0:1788582190.433305:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 458: rc = 0 00100000:10000000:2.0:1788582190.436779:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 458: rc = 0 00100000:10000000:2.0:1788582190.437042:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 458: rc = 0 00100000:10000000:2.0:1788582190.437323:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 458: rc = 0 00100000:10000000:2.0:1788582190.437595:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 458: rc = 0 00100000:10000000:2.0:1788582190.437839:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 458: rc = 0 00100000:10000000:2.0:1788582190.438081:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 458: rc = 0 00100000:10000000:2.0:1788582190.438353:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 458: rc = 0 00100000:10000000:2.0:1788582190.441564:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 556: rc = 0 00100000:10000000:2.0:1788582190.442083:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 556: rc = 0 00100000:10000000:2.0:1788582190.443427:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 556: rc = 0 00100000:10000000:2.0:1788582190.443859:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 556: rc = 0 00100000:10000000:2.0:1788582190.444398:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 556: rc = 0 00100000:10000000:2.0:1788582190.444816:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 556: rc = 0 00100000:10000000:2.0:1788582190.445429:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 556: rc = 0 00100000:10000000:2.0:1788582190.445899:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 556: rc = 0 00100000:10000000:2.0:1788582190.446557:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 556: rc = 0 00100000:10000000:2.0:1788582190.450853:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 556: rc = 0 00100000:10000000:2.0:1788582190.455872:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 556: rc = 0 00100000:10000000:2.0:1788582190.457751:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 556: rc = 0 00100000:10000000:2.0:1788582190.459614:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 556: rc = 0 00100000:10000000:2.0:1788582190.459995:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 556: rc = 0 00100000:10000000:3.0:1788582190.462439:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 556: rc = 0 00100000:10000000:3.0:1788582190.462919:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 556: rc = 0 00100000:10000000:3.0:1788582190.464667:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 556: rc = 0 00100000:10000000:3.0:1788582190.464930:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 556: rc = 0 00100000:10000000:3.0:1788582190.467021:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 556: rc = 0 00100000:10000000:3.0:1788582190.467476:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 556: rc = 0 00100000:10000000:3.0:1788582190.467724:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 556: rc = 0 00100000:10000000:3.0:1788582190.467993:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 556: rc = 0 00100000:10000000:3.0:1788582190.471547:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 556: rc = 0 00100000:10000000:3.0:1788582190.471805:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 556: rc = 0 00100000:10000000:3.0:1788582190.472071:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 556: rc = 0 00100000:10000000:3.0:1788582190.472387:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 556: rc = 0 00100000:10000000:3.0:1788582190.472640:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 556: rc = 0 00100000:10000000:3.0:1788582190.472895:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 556: rc = 0 00100000:10000000:3.0:1788582190.473162:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 556: rc = 0 00100000:10000000:3.0:1788582190.473447:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 556: rc = 0 00100000:10000000:3.0:1788582190.473693:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 556: rc = 0 00100000:10000000:3.0:1788582190.473938:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 556: rc = 0 00100000:10000000:3.0:1788582190.474345:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 472: rc = 0 00100000:10000000:3.0:1788582190.485693:0:14402:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1788582190.486138:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 450: rc = 0 00100000:10000000:3.0:1788582190.486404:0:14402:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1788582190.486477:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 450: rc = 0 00100000:10000000:3.0:1788582190.487070:0:14402:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1788582190.487155:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 450: rc = 0 00100000:10000000:3.0:1788582190.487871:0:14402:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1788582190.488085:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 454: rc = 0 00100000:10000000:3.0:1788582190.488316:0:14402:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1788582190.488400:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 454: rc = 0 00100000:10000000:3.0:1788582190.488584:0:14402:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1788582190.488649:0:14402:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 454: rc = 0 00000020:00000080:3.0:1788582190.490671:0:14402:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788582190.490692:0:14402:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788582190.490711:0:14402:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bc3aa892c3a7b98 00000020:01000004:3.0:1788582190.490721:0:14402:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1788582190.490727:0:14402:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788582190.490734:0:14402:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d0dbbdde000 from MGS 00000020:01000004:3.0:1788582190.490737:0:14402:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788582190.490750:0:14402:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8d0d97e9cd28) 00000020:00000080:3.0:1788582190.490761:0:14402:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788582190.490832:0:14402:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d0dbbdde000 from MGS, refs=2 00080000:01000000:3.0:1788582190.490848:0:14402:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788582190.490854:0:14402:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bc3aa892c3a7ba6 00000100:00100000:3.0:1788582190.490984:0:14402:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788582190.491110:0:14402:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788582190.491116:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788582190.492774:0:14402:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788582190.492784:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788582190.493662:0:14402:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788582190.493848:0:14402:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788582190.493854:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788582190.494842:0:14402:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788582190.494853:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788582190.495669:0:14402:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788582190.495684:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788582190.500104:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582190.500111:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582190.500114:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582190.501560:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582190.501565:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582190.501567:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582190.504319:0:14402:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1788582190.516248:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788582190.545109:0:14402:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788582190.545127:0:14402:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788582190.545130:0:14402:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1788582190.549419:0:14411:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788582190.550158:0:14402:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788582190.550311:0:14402:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788582190.551003:0:14402:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788582190.551540:0:14402:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788582190.551925:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788582190.551932:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788582190.553280:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788582190.553290:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788582190.553757:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788582190.553764:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:1.0:1788582190.556312:0:14416:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:2.0:1788582190.556461:0:14402:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788582190.556486:0:14402:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.201.112@tcp' 00000020:01000004:2.0:1788582190.556488:0:14402:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788582190.556522:0:14402:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.201.112@tcp (typ=mgc) 00000020:00000080:2.0:1788582190.556535:0:14402:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.112@tcp (ffff8d0dbf4e0000) 00000020:00000080:2.0:1788582190.556552:0:14402:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788582190.556631:0:14402:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d0dbbddf800@MGC192.168.201.112@tcp: add connection 192.168.201.112@tcp at head 00010000:00010000:2.0:1788582190.556999:0:14402:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.112@tcp-0 is initialized 00000040:01000000:2.0:1788582190.557005:0:14402:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.112@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788582190.562349:0:14417:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788582190.572323:0:14402:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.112@tcp (uuid 9415e791-1a3c-4924-bcfc-d6d86718d620) 00000020:00000080:2.0:1788582190.572359:0:14402:0:(genops.c:1385:class_connect()) connect: client 9415e791-1a3c-4924-bcfc-d6d86718d620, cookie 0x2bc3aa892c3a7bb4 00000100:00080000:2.0:1788582190.572382:0:14402:0:(import.c:510:import_select_connection()) MGC192.168.201.112@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788582190.572390:0:14402:0:(import.c:624:import_select_connection()) MGC192.168.201.112@tcp: import ffff8d0dbbddf800 using connection 192.168.201.112@tcp/0@lo 00000100:00100000:2.0:1788582190.572428:0:14402:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0dbaeab800 x1875464020902528/t0(0) o250->MGC192.168.201.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788582190.572465:0:14402:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 9415e791-1a3c-4924-bcfc-d6d86718d620->MGS 00000020:01000004:2.0:1788582190.572497:0:14402:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788582190.572503:0:14402:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788582190.572527:0:14402:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8d0dbf4e4d28) 00000020:00000080:2.0:1788582190.572540:0:14402:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788582190.576917:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaeab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9415e791-1a3c-4924-bcfc-d6d86718d620:3305:1875464020902528:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788582190.576993:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582190.577416:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020902528 00000100:00100000:1.0:1788582190.577426:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020902528 00000100:00100000:1.0:1788582190.577470:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788582190.577478:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3305:x1875464020902528:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788582190.577507:0:14413:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9415e791-1a3c-4924-bcfc-d6d86718d620@0@lo t0 exp 0000000000000000 cur 409 last 0 00000020:00000080:1.0:1788582190.577535:0:14413:0:(genops.c:1385:class_connect()) connect: client 9415e791-1a3c-4924-bcfc-d6d86718d620, cookie 0x2bc3aa892c3a7bc2 00000100:00080000:1.0:1788582190.577672:0:14413:0:(import.c:65:import_set_state_nolock()) ffff8d0d84e82800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788582190.577730:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+5:3305:x1875464020902528:12345-0@lo:250:mount.lustre.0 Request processed in 251us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582190.577738:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788582190.577779:0:3305:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.201.112@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788582190.577788:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.201.112@tcp: connect to target with instance 0 00000100:00080000:1.0:1788582190.577795:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.201.112@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788582190.577801:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788582190.577804:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0dbbddf800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788582190.577807:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788582190.577815:0:3305:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788582190.577821:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaeab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:9415e791-1a3c-4924-bcfc-d6d86718d620:3305:1875464020902528:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788582190.590577:0:14402:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788582190.590768:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788582190.590775:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788582190.595101:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788582190.595116:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788582190.595849:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788582190.595857:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788582190.596633:0:14402:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788582190.597050:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788582190.597057:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788582190.600532:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788582190.600547:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788582190.648815:0:14402:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788582190.649028:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788582190.649034:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788582190.653634:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788582190.653647:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1788582190.654627:0:14402:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788582190.655018:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788582190.655024:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1788582190.655612:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788582190.655619:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1788582190.656131:0:14402:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788582190.656330:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788582190.656336:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788582190.658796:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788582190.658811:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1788582190.665464:0:14402:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788582190.665651:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1788582190.665658:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1788582190.669707:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1788582190.669721:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788582190.699803:0:14402:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788582190.700032:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788582190.700039:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1788582190.702412:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788582190.702427:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1788582190.703594:0:14402:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1788582190.703606:0:14402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788582190.704663:0:14402:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1788582190.704977:0:14402:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1788582190.704985:0:14402:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.112@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1788582190.705388:0:14402:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.112@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788582190.705425:0:14402:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.112@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1788582190.705429:0:14402:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788582190.705431:0:14402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788582190.705432:0:14402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788582190.705433:0:14402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788582190.705435:0:14402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788582190.705436:0:14402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788582190.705442:0:14402:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788582190.705443:0:14402:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788582190.705444:0:14402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788582190.705446:0:14402:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788582190.705448:0:14402:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1788582190.705450:0:14402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788582190.705451:0:14402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788582190.705452:0:14402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788582190.705453:0:14402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788582190.705454:0:14402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788582190.705455:0:14402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788582190.705455:0:14402:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788582190.705456:0:14402:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788582190.705457:0:14402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788582190.705458:0:14402:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788582190.705484:0:14402:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788582190.705505:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020902656:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788582190.705580:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582190.705694:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d909e76c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788582190.707435:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020902656 00000100:00100000:2.0:1788582190.707448:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020902656 00000100:00100000:2.0:1788582190.707538:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788582190.707549:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+5:14402:x1875464020902656:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788582190.707612:0:14415:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788582190.707615:0:14415:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788582190.707618:0:14415:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788582190.708259:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788582190.708640:0:14415:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1788582190.713603:0:14437:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788582190.713612:0:14437:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788582190.713615:0:14437:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788582190.713666:0:14437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1788582190.714012:0:14415:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788582190.714022:0:14415:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1788582190.732112:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+5:14402:x1875464020902656:12345-0@lo:253:mount.lustre.0 Request processed in 24549us (26516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582190.732128:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788582190.732314:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020902656:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788582190.732329:0:14402:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788582190.732333:0:14402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788582190.732335:0:14402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788582190.732336:0:14402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788582190.732337:0:14402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788582190.732339:0:14402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788582190.732340:0:14402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788582190.732341:0:14402:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788582190.732343:0:14402:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788582190.732344:0:14402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788582190.732346:0:14402:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788582190.732371:0:14402:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d0dbbdde000 from lustre-MDT0000 10000000:01000000:1.0:1788582190.732397:0:14402:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788582190.732400:0:14402:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788582190.732404:0:14402:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d0dbf4e0000 10000000:01000000:1.0:1788582190.732408:0:14402:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788582190.732428:0:14402:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d0dbf4e0000 from 1 10000000:01000000:1.0:1788582190.732432:0:14402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788582190.732467:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da71fcc00/0x2bc3aa892c3a7bc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582190.732478:0:14402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0da71fcc00/0x2bc3aa892c3a7bc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582190.732488:0:14402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0da71fcc00/0x2bc3aa892c3a7bc9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582190.732505:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020902784:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788582190.732539:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582190.732564:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d909e7240 going to sleep for 11 seconds 00000100:00100000:0.0:1788582190.732685:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020902784 00000100:00100000:0.0:1788582190.732692:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020902784 00000100:00100000:0.0:1788582190.732728:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788582190.732737:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d917e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+5:14402:x1875464020902784:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788582190.733076:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582190.733093:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0da7089200/0x2bc3aa892c3a7bd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a7bc9 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582190.733118:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0da7089200/0x2bc3aa892c3a7bd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7bc9 expref: 6 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582190.733128:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0da7089200/0x2bc3aa892c3a7bd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7bc9 expref: 6 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582190.733138:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7089200, rc 0) 00000100:00100000:0.0:1788582190.733189:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d917e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+6:14402:x1875464020902784:12345-0@lo:101:mount.lustre.0 Request processed in 453us (649us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582190.733244:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788582190.733337:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020902784:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788582190.733350:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0da71fcc00/0x2bc3aa892c3a7bc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7bd0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582190.733370:0:14402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0da71fcc00/0x2bc3aa892c3a7bc9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a7bd0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582190.733421:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020902912:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788582190.733446:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582190.733464:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d909e7240 going to sleep for 11 seconds 00000100:00100000:2.0:1788582190.735378:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020902912 00000100:00100000:2.0:1788582190.735391:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020902912 00000100:00100000:2.0:1788582190.735441:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788582190.735448:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d917e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+6:14402:x1875464020902912:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788582190.735700:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d917e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+6:14402:x1875464020902912:12345-0@lo:501:mount.lustre.0 Request processed in 251us (2252us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788582190.735708:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788582190.736470:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020902912:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788582190.736506:0:14402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788582190.736527:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da71fcc00/0x2bc3aa892c3a7bc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7bd0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582190.736538:0:14402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0da71fcc00/0x2bc3aa892c3a7bc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7bd0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788582190.736547:0:14402:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d0dbbdde000 10000000:01000000:0.0:1788582190.736552:0:14402:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788582190.736556:0:14402:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d0dbbdde000 10000000:01000000:0.0:1788582190.736558:0:14402:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788582190.736562:0:14402:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d0dbbdde000 from 1 10000000:01000000:0.0:1788582190.736564:0:14402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788582190.736596:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7088800/0x2bc3aa892c3a7bd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582190.736605:0:14402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0da7088800/0x2bc3aa892c3a7bd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582190.736615:0:14402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0da7088800/0x2bc3aa892c3a7bd7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582190.736632:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf377800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020903040:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788582190.736666:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582190.736709:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d866ec540 going to sleep for 11 seconds 00000100:00100000:1.0:1788582190.736767:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020903040 00000100:00100000:1.0:1788582190.736781:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020903040 00000100:00100000:1.0:1788582190.736823:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788582190.736832:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+6:14402:x1875464020903040:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788582190.736842:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582190.736869:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0da71fc400/0x2bc3aa892c3a7bde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a7bd7 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582190.736889:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0da71fc400/0x2bc3aa892c3a7bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7bd7 expref: 7 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582190.736898:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0da71fc400/0x2bc3aa892c3a7bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7bd7 expref: 7 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582190.736907:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fc400, rc 0) 00000100:00100000:1.0:1788582190.736944:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+7:14402:x1875464020903040:12345-0@lo:101:mount.lustre.0 Request processed in 114us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582190.736950:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788582190.737347:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf377800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020903040:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788582190.737379:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0da7088800/0x2bc3aa892c3a7bd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7bde expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582190.737388:0:14402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0da7088800/0x2bc3aa892c3a7bd7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a7bde expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788582190.737401:0:14402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788582190.737416:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7088800/0x2bc3aa892c3a7bd7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7bde expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582190.737423:0:14402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0da7088800/0x2bc3aa892c3a7bd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7bde expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788582190.737428:0:14402:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788582190.737432:0:14402:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788582190.737436:0:14402:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d0dbbdde000 10000000:01000000:0.0:1788582190.737438:0:14402:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788582190.737441:0:14402:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788582190.737443:0:14402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788582190.737457:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7088e00/0x2bc3aa892c3a7be5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582190.737464:0:14402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0da7088e00/0x2bc3aa892c3a7be5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582190.737471:0:14402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0da7088e00/0x2bc3aa892c3a7be5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582190.737482:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf377800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020903168:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788582190.737517:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582190.737540:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d866ec540 going to sleep for 11 seconds 00000100:00100000:1.0:1788582190.737951:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020903168 00000100:00100000:1.0:1788582190.737957:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020903168 00000100:00100000:1.0:1788582190.737997:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788582190.738006:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+7:14402:x1875464020903168:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788582190.738016:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582190.738027:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0da71fc000/0x2bc3aa892c3a7bec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a7be5 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582190.738044:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0da71fc000/0x2bc3aa892c3a7bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7be5 expref: 8 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582190.738054:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0da71fc000/0x2bc3aa892c3a7bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7be5 expref: 8 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582190.738061:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fc000, rc 0) 00000100:00100000:1.0:1788582190.738108:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+8:14402:x1875464020903168:12345-0@lo:101:mount.lustre.0 Request processed in 103us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582190.738124:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788582190.738312:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf377800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020903168:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788582190.738324:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0da7088e00/0x2bc3aa892c3a7be5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7bec expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582190.738333:0:14402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0da7088e00/0x2bc3aa892c3a7be5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a7bec expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582190.738388:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020903296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788582190.738412:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582190.738439:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da9a91b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788582190.738502:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020903296 00000100:00100000:3.0:1788582190.738506:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020903296 00000100:00100000:3.0:1788582190.738526:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788582190.738531:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+8:14402:x1875464020903296:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788582190.738903:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+9:14402:x1875464020903296:12345-0@lo:501:mount.lustre.0 Request processed in 370us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582190.738910:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788582190.739083:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020903296:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788582190.739120:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020903424:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788582190.739156:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582190.739184:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da9a91b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788582190.740230:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020903424 00000100:00100000:3.0:1788582190.740240:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020903424 00000100:00100000:3.0:1788582190.740272:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788582190.740278:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+9:14402:x1875464020903424:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788582190.740636:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+9:14402:x1875464020903424:12345-0@lo:503:mount.lustre.0 Request processed in 356us (1478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582190.740644:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788582190.740924:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020903424:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788582190.744614:0:14438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9415e791-1a3c-4924-bcfc-d6d86718d620:14438:1875464020903552:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788582190.744843:0:14438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582190.744934:0:14438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d866ec3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788582190.745163:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020903552 00000100:00100000:3.0:1788582190.748302:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020903552 00000100:00100000:3.0:1788582190.748425:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788582190.748436:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+9:14438:x1875464020903552:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788582190.748856:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+9:14438:x1875464020903552:12345-0@lo:502:llog_process_th.0 Request processed in 420us (4109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582190.748864:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788582190.748965:0:14438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9415e791-1a3c-4924-bcfc-d6d86718d620:14438:1875464020903552:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788582190.749003:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788582190.749014:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788582190.749016:0:14438:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788582190.749021:0:14438:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1788582190.749024:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788582190.749038:0:14438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8d0dbfb40000) 00000020:00000080:1.0:1788582190.749057:0:14438:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1788582190.749064:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1788582190.749139:0:14438:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:1.0:1788582190.749147:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bc3aa892c3a7bfa 00000020:00000080:1.0:1788582190.749389:0:14438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788582190.749393:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788582190.749396:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788582190.749398:0:14438:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1788582190.749400:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788582190.749403:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788582190.749405:0:14438:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1788582190.749408:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788582190.749414:0:14438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8d0dbfb419b8) 00000020:00000080:1.0:1788582190.749424:0:14438:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1788582190.749427:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1788582190.749429:0:14438:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1788582190.749432:0:14438:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1788582190.749437:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788582190.749481:0:14438:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d0dbbdde000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1788582190.749493:0:14438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8d0dbfb44d28) 00000020:00000080:1.0:1788582190.749501:0:14438:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1788582190.749539:0:14438:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1788582190.749543:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bc3aa892c3a7c0f 00000020:00000080:1.0:1788582190.749634:0:14438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1788582190.749640:0:14438:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1788582190.749644:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x2bc3aa892c3a7c16 00080000:01000000:1.0:1788582190.749649:0:14438:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788582190.749652:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bc3aa892c3a7c1d 00010000:00010000:2.0:1788582190.865690:0:14438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788582190.867074:0:14438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788582190.867565:0:14438:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788582190.869520:0:14438:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8d0dbf4e3370) 00000020:00000080:1.0:1788582190.881547:0:14438:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788582190.881672:0:14438:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788582190.881692:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bc3aa892c3a7c2b 00000020:00000080:1.0:1788582190.885906:0:14438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788582190.902493:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x2bc3aa892c3a7c32 00000020:00000080:2.0:1788582190.906628:0:14438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788582190.906641:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788582190.906648:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788582190.906650:0:14438:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788582190.906655:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788582190.906658:0:14438:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1788582190.906660:0:14438:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788582190.906661:0:14438:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788582190.906663:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788582190.906666:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788582190.906667:0:14438:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788582190.906670:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788582190.906688:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788582190.906690:0:14438:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788582190.906695:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788582190.906739:0:14438:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788582190.906765:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788582190.906776:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788582190.906778:0:14438:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788582190.906781:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788582190.906784:0:14438:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1788582190.906787:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788582190.906789:0:14438:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788582190.906792:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788582190.906797:0:14438:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.112@tcp to nid 0x20000c0a8c970 (192.168.201.112@tcp) 00000020:01000000:2.0:1788582190.906823:0:14438:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788582190.906826:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788582190.906865:0:14438:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d0dae444d28) 00000020:00000080:2.0:1788582190.906882:0:14438:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788582190.906889:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788582190.906954:0:14438:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788582190.906961:0:14438:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788582190.906967:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bc3aa892c3a7c40 00010000:00080000:2.0:1788582190.906998:0:14438:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d0dbbd46000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.112@tcp at head 00010000:00010000:2.0:1788582190.909648:0:14438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1788582190.910589:0:14438:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788582190.910636:0:14438:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788582190.916494:0:14438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788582190.916560:0:14438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788582190.916644:0:14438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788582190.917148:0:14442:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788582190.917153:0:14442:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788582190.918274:0:14438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788582190.918286:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788582190.918314:0:14438:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788582190.918330:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bc3aa892c3a7c47 00000100:00080000:1.0:1788582190.918340:0:14438:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788582190.918345:0:14438:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d0dbbd46000 using connection 192.168.201.112@tcp/0@lo 00000100:00100000:1.0:1788582190.918413:0:14438:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0dbbdc2680 x1875464020903680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788582190.918442:0:14438:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788582190.918491:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788582190.918495:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788582190.918497:0:14438:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788582190.918500:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788582190.918503:0:14438:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788582190.918504:0:14438:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788582190.918505:0:14438:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788582190.918507:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788582190.918509:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788582190.918510:0:14438:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788582190.918513:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788582190.918516:0:14438:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1788582190.918519:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788582190.918527:0:14438:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788582190.918531:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788582190.918535:0:14438:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.201.112@tcp to nid 0x20000c0a8c970 (192.168.201.112@tcp) 00000020:01000000:1.0:1788582190.918558:0:14438:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788582190.918560:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788582190.918571:0:14438:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d0dbfb43370) 00000020:00000080:1.0:1788582190.918580:0:14438:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788582190.918584:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788582190.918644:0:14438:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1788582190.918650:0:14438:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788582190.918655:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x2bc3aa892c3a7c55 00010000:00080000:1.0:1788582190.918682:0:14438:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d0da7180000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.112@tcp at head 00000100:00100000:2.0:1788582190.919002:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020903680:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788582190.919053:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875464020903680 offset 0 length 520: 4 00010000:00010000:1.0:1788582190.919415:0:14438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788582190.919585:0:14438:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788582190.919607:0:14438:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788582190.921018:0:14438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788582190.921097:0:14438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1788582190.921635:0:14438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1788582190.925678:0:14444:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788582190.925685:0:14444:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788582190.927132:0:14438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788582190.927145:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788582190.927179:0:14438:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788582190.927300:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bc3aa892c3a7c5c 00000100:00080000:2.0:1788582190.927313:0:14438:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788582190.927319:0:14438:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d0da7180000 using connection 192.168.201.112@tcp/0@lo 00000100:00100000:2.0:1788582190.927365:0:14438:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0dbaea8380 x1875464020903808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788582190.927421:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020903808:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788582190.927492:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875464020903808 offset 0 length 520: 4 00000100:00080000:2.0:1788582190.927548:0:14438:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788582190.927606:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788582190.927611:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788582190.927613:0:14438:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788582190.927616:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788582190.927619:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788582190.927621:0:14438:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788582190.927631:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788582190.927633:0:14438:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788582190.927635:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788582190.927638:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788582190.927639:0:14438:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788582190.927641:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788582190.927644:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788582190.927645:0:14438:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788582190.927649:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788582190.927677:0:14438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaeab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9415e791-1a3c-4924-bcfc-d6d86718d620:14438:1875464020903936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788582190.927728:0:14438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582190.927822:0:14438:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d90ebeb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788582190.930276:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020903936 00000100:00100000:0.0:1788582190.930291:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020903936 00000100:00100000:0.0:1788582190.930351:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788582190.930371:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+9:14438:x1875464020903936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788582190.930669:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+9:14438:x1875464020903936:12345-0@lo:502:llog_process_th.0 Request processed in 300us (2941us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582190.930678:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788582190.930981:0:14438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaeab800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9415e791-1a3c-4924-bcfc-d6d86718d620:14438:1875464020903936:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788582190.931019:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788582190.931027:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788582190.931030:0:14438:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788582190.931034:0:14438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788582190.931687:0:14402:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788582190.931709:0:14402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788582190.931768:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7088e00/0x2bc3aa892c3a7be5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7bec expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582190.931781:0:14402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0da7088e00/0x2bc3aa892c3a7be5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7bec expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788582190.931790:0:14402:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d0dbbdde000 from 1 10000000:01000000:2.0:1788582190.931793:0:14402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788582190.931829:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04000/0x2bc3aa892c3a7c63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582190.931837:0:14402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04000/0x2bc3aa892c3a7c63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582190.931847:0:14402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04000/0x2bc3aa892c3a7c63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582190.931867:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020904064:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788582190.931933:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582190.931970:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d90ebe6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788582190.932178:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020904064 00000100:00100000:3.0:1788582190.932185:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020904064 00000100:00100000:3.0:1788582190.932250:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788582190.932259:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+9:14402:x1875464020904064:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788582190.932271:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582190.932287:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a7c6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a7c63 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582190.932310:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a7c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7c63 expref: 10 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582190.932328:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a7c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7c63 expref: 10 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582190.932337:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27000, rc 0) 00000100:00100000:3.0:1788582190.932387:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+10:14402:x1875464020904064:12345-0@lo:101:mount.lustre.0 Request processed in 128us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582190.932394:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788582190.932435:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020904064:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788582190.932448:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04000/0x2bc3aa892c3a7c63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7c6a expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582190.932456:0:14402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04000/0x2bc3aa892c3a7c63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a7c6a expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582190.933134:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020904192:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1788582190.933175:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582190.933236:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85834000 going to sleep for 11 seconds 00000100:00100000:2.0:1788582190.933712:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020904192 00000100:00100000:2.0:1788582190.933720:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020904192 00000100:00100000:2.0:1788582190.933773:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788582190.933781:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+10:14402:x1875464020904192:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1788582190.933800:0:14413:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1788582190.933806:0:14413:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1788582190.933887:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+10:14402:x1875464020904192:12345-0@lo:256:mount.lustre.0 Request processed in 106us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582190.933894:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788582190.934030:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020904192:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1788582190.934638:0:14402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788582190.935708:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04000/0x2bc3aa892c3a7c63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7c6a expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582190.935723:0:14402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04000/0x2bc3aa892c3a7c63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7c6a expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788582190.935732:0:14402:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0dbbdde000 from 1 10000000:01000000:1.0:1788582190.935757:0:14402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788582190.935794:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da71fd800/0x2bc3aa892c3a7c71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582190.935803:0:14402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0da71fd800/0x2bc3aa892c3a7c71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582190.935813:0:14402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0da71fd800/0x2bc3aa892c3a7c71 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582190.935836:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020904320:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788582190.935893:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582190.935924:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8a9349c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788582190.936063:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020904320 00000100:00100000:2.0:1788582190.936070:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020904320 00000100:00100000:2.0:1788582190.936121:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788582190.936129:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+10:14402:x1875464020904320:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788582190.936141:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582190.936156:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7c78 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a7c71 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582190.936178:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7c78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7c71 expref: 11 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582190.936188:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7c78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7c71 expref: 11 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582190.936196:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04a00, rc 0) 00000100:00100000:2.0:1788582190.936263:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+11:14402:x1875464020904320:12345-0@lo:101:mount.lustre.0 Request processed in 134us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582190.936279:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788582190.936441:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020904320:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788582190.936454:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0da71fd800/0x2bc3aa892c3a7c71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7c78 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582190.936462:0:14402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0da71fd800/0x2bc3aa892c3a7c71 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a7c78 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582190.936511:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020904448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788582190.936534:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582190.936559:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8a9349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788582190.936599:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020904448 00000100:00100000:3.0:1788582190.936604:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020904448 00000100:00100000:3.0:1788582190.936632:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788582190.936640:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+11:14402:x1875464020904448:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788582190.937036:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+11:14402:x1875464020904448:12345-0@lo:501:mount.lustre.0 Request processed in 396us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582190.937044:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788582190.937526:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020904448:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788582190.937564:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020904576:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788582190.937606:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582190.937631:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8a9349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788582190.937722:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020904576 00000100:00100000:3.0:1788582190.937727:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020904576 00000100:00100000:3.0:1788582190.937863:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788582190.937871:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+11:14402:x1875464020904576:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788582190.938030:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+11:14402:x1875464020904576:12345-0@lo:503:mount.lustre.0 Request processed in 160us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582190.938037:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788582190.938113:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020904576:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788582190.938587:0:14446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9415e791-1a3c-4924-bcfc-d6d86718d620:14446:1875464020904704:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788582190.938629:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582190.938658:0:14446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d866ec540 going to sleep for 11 seconds 00000100:00100000:2.0:1788582190.938694:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020904704 00000100:00100000:2.0:1788582190.938698:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020904704 00000100:00100000:2.0:1788582190.938732:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788582190.938741:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+11:14446:x1875464020904704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788582190.938947:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+11:14446:x1875464020904704:12345-0@lo:502:llog_process_th.0 Request processed in 206us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582190.938954:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788582190.939091:0:14446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9415e791-1a3c-4924-bcfc-d6d86718d620:14446:1875464020904704:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788582190.939116:0:14446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788582190.939125:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788582190.939127:0:14446:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788582190.939135:0:14446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d0dbbdde000 00000020:00000080:0.0:1788582190.939138:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788582190.939147:0:14446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788582190.939149:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788582190.939151:0:14446:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788582190.939153:0:14446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788582190.939162:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788582190.939163:0:14446:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788582190.939168:0:14446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d0dbbdde000 00000020:00000080:0.0:1788582190.939170:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788582190.939253:0:14446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788582190.939257:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788582190.939258:0:14446:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788582190.939260:0:14446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788582190.939263:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788582190.939264:0:14446:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788582190.939268:0:14446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d0dbbdde000 00000020:00000080:0.0:1788582190.939270:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788582190.939309:0:14446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9415e791-1a3c-4924-bcfc-d6d86718d620:14446:1875464020904832:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788582190.939344:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582190.939370:0:14446:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c8364b900 going to sleep for 11 seconds 00000100:00100000:2.0:1788582190.943884:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020904832 00000100:00100000:2.0:1788582190.943900:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020904832 00000100:00100000:2.0:1788582190.943964:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788582190.943975:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+11:14446:x1875464020904832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788582190.944249:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+11:14446:x1875464020904832:12345-0@lo:502:llog_process_th.0 Request processed in 275us (4902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582190.944257:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788582190.947353:0:14446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9415e791-1a3c-4924-bcfc-d6d86718d620:14446:1875464020904832:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788582190.947409:0:14446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788582190.947417:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788582190.947419:0:14446:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788582190.947424:0:14446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788582190.953132:0:14402:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788582190.953167:0:14402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788582190.954061:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da71fd800/0x2bc3aa892c3a7c71 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7c78 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582190.954077:0:14402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0da71fd800/0x2bc3aa892c3a7c71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7c78 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788582190.954147:0:14402:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788582190.954150:0:14402:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d0dbbdde000 10000000:01000000:3.0:1788582190.954153:0:14402:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d0dbbdde000 10000000:01000000:3.0:1788582190.954157:0:14402:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788582190.954172:0:14402:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0dbbdde000 from 1 10000000:01000000:3.0:1788582190.954175:0:14402:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788582190.954228:0:14402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26800/0x2bc3aa892c3a7c7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582190.954237:0:14402:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26800/0x2bc3aa892c3a7c7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582190.954249:0:14402:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26800/0x2bc3aa892c3a7c7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582190.954274:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020904960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788582190.954349:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582190.954401:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d909e76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788582190.954438:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020904960 00000100:00100000:3.0:1788582190.954444:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020904960 00000100:00100000:3.0:1788582190.954483:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788582190.954490:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+11:14402:x1875464020904960:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788582190.954503:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582190.954514:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d88e26000/0x2bc3aa892c3a7c86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a7c7f expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582190.954535:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d88e26000/0x2bc3aa892c3a7c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7c7f expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582190.954547:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d88e26000/0x2bc3aa892c3a7c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7c7f expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582190.954555:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26000, rc 0) 00000100:00100000:3.0:1788582190.954590:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+12:14402:x1875464020904960:12345-0@lo:101:mount.lustre.0 Request processed in 100us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582190.954596:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788582190.954639:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020904960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788582190.954651:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26800/0x2bc3aa892c3a7c7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7c86 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582190.954660:0:14402:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26800/0x2bc3aa892c3a7c7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a7c86 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582190.954716:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020905088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788582190.955848:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582190.955888:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d909e76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788582190.955996:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020905088 00000100:00100000:0.0:1788582190.956004:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020905088 00000100:00100000:0.0:1788582190.956043:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788582190.956053:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+12:14402:x1875464020905088:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788582190.956390:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+12:14402:x1875464020905088:12345-0@lo:501:mount.lustre.0 Request processed in 337us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582190.956398:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788582190.957280:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020905088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788582190.957332:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020905216:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788582190.959308:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582190.959371:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d909e76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788582190.959468:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020905216 00000100:00100000:0.0:1788582190.959477:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020905216 00000100:00100000:0.0:1788582190.959536:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788582190.959546:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+12:14402:x1875464020905216:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788582190.959850:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+12:14402:x1875464020905216:12345-0@lo:503:mount.lustre.0 Request processed in 304us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582190.959858:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788582190.959959:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020905216:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788582190.964496:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9415e791-1a3c-4924-bcfc-d6d86718d620:14450:1875464020905344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788582190.964581:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582190.964631:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da7194480 going to sleep for 11 seconds 00000100:00100000:0.0:1788582190.965429:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020905344 00000100:00100000:0.0:1788582190.965439:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020905344 00000100:00100000:0.0:1788582190.965486:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788582190.965495:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+12:14450:x1875464020905344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788582190.965766:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+12:14450:x1875464020905344:12345-0@lo:502:llog_process_th.0 Request processed in 271us (1184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582190.965775:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788582190.967255:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c1c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9415e791-1a3c-4924-bcfc-d6d86718d620:14450:1875464020905344:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788582190.967330:0:14450:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788582190.967346:0:14450:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8d0dae443370) 00000020:00000080:2.0:1788582190.967382:0:14450:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1788582190.967481:0:14450:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d0dbbdde000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788582190.967485:0:14450:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d0dbbdde000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788582190.967488:0:14450:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0dbbdde000 4 00010000:00080000:2.0:1788582190.967519:0:14450:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d0db7748000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.112@tcp at head 00010000:00010000:2.0:1788582190.970655:0:14450:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1788582190.975441:0:14450:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788582190.975509:0:14450:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788582190.975538:0:14450:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x2bc3aa892c3a7c94 00000100:00080000:2.0:1788582190.975550:0:14450:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788582190.975558:0:14450:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d0db7748000 using connection 192.168.201.112@tcp/0@lo 00000100:00100000:2.0:1788582190.975598:0:14450:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0dbaea9500 x1875464020905472/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788582190.975654:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875464020905472:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788582190.976370:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788582190.976437:0:14450:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1788582190.978537:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020905472 00000100:00100000:1.0:1788582190.978552:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020905472 00000100:00100000:1.0:1788582190.978595:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788582190.978605:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaeaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875464020905472:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788582190.978708:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaeaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875464020905472:12345-0@lo:38:llog_process_th.0 Request processed in 103us (2338us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788582190.978715:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788582190.981870:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788582190.981884:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0db7748000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788582190.981891:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788582190.981896:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875464020905472:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788582190.988526:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9415e791-1a3c-4924-bcfc-d6d86718d620:14450:1875464020905600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788582190.988610:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582190.988650:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8a976d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788582190.988691:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020905600 00000100:00100000:2.0:1788582190.988700:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020905600 00000100:00100000:2.0:1788582190.988743:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788582190.988752:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+12:14450:x1875464020905600:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788582190.988990:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+12:14450:x1875464020905600:12345-0@lo:502:llog_process_th.0 Request processed in 237us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582190.988998:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788582190.989052:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:9415e791-1a3c-4924-bcfc-d6d86718d620:14450:1875464020905600:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788582190.989078:0:14450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1788582190.991152:0:14402:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788582190.991184:0:14402:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788582190.991771:0:14402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26800/0x2bc3aa892c3a7c7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7c86 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582190.991785:0:14402:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26800/0x2bc3aa892c3a7c7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7c86 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788582190.991834:0:14402:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788582190.991836:0:14402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788582190.991837:0:14402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788582190.991838:0:14402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788582190.991840:0:14402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788582190.991841:0:14402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788582190.991842:0:14402:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788582190.991844:0:14402:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788582190.991845:0:14402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788582190.991847:0:14402:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788582190.991850:0:14402:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788582190.991857:0:14402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788582190.991858:0:14402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788582190.991859:0:14402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788582190.991860:0:14402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788582190.991861:0:14402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788582190.991862:0:14402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788582190.991863:0:14402:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788582190.991864:0:14402:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788582190.991864:0:14402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788582190.991865:0:14402:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788582190.991892:0:14402:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788582190.991910:0:14402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020905728:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788582190.991982:0:14402:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582190.992018:0:14402:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbf75fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788582190.992063:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020905728 00000100:00100000:0.0:1788582190.992070:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020905728 00000100:00100000:0.0:1788582190.992111:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788582190.992119:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+12:14402:x1875464020905728:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788582190.992144:0:14414:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788582190.992156:0:14414:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788582191.056118:0:14414:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788582191.056138:0:14414:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788582191.056182:0:14436:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788582191.056187:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788582191.056256:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7c9b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582191.056275:0:14436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a7c6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7c63 expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582191.056283:0:14436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7c9b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582191.056323:0:14436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a7c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a7c63 expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582191.056337:0:14436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a7c6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7c63 expref: 12 pid: 14415 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582191.056351:0:14436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14436:1875464020905856:0@lo:104: 00000100:00100000:3.0:1788582191.056434:0:14436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582191.056476:0:14436:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d866ec9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788582191.057325:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020905856 00000100:00100000:1.0:1788582191.057336:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020905856 00000100:00100000:1.0:1788582191.057407:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788582191.057417:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9415e791-1a3c-4924-bcfc-d6d86718d620+3:14436:x1875464020905856:12345-0@lo:104: 00010000:00010000:1.0:1788582191.057434:0:14403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04000/0x2bc3aa892c3a7c63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a7c6a expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582191.057498:0:14403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788582191.057505:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9415e791-1a3c-4924-bcfc-d6d86718d620+3:14436:x1875464020905856:12345-0@lo:104: Request processed in 89us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582191.057511:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788582191.058253:0:14436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14436:1875464020905856:0@lo:104: 00010000:00010000:3.0:1788582191.058277:0:14436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7c9b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582191.058296:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788582191.058302:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04000/0x2bc3aa892c3a7c63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a7c6a expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582191.058310:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04000 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:3.0:1788582191.058314:0:14409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04000/0x2bc3aa892c3a7c63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a7c6a expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582191.058323:0:14409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04000/0x2bc3aa892c3a7c63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a7c6a expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788582191.058331:0:14409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04000/0x2bc3aa892c3a7c63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a7c6a expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788582191.058337:0:14409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788582191.058383:0:14409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04000/0x2bc3aa892c3a7c63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a7c6a expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582191.058390:0:14409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788582191.058409:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04000/0x2bc3aa892c3a7c63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a7c6a expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582191.058416:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04000/0x2bc3aa892c3a7c63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a7c6a expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582191.058445:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582191.058447:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582191.058448:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582191.059373:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9415e791-1a3c-4924-bcfc-d6d86718d620:3308:1875464020905984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788582191.059431:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582191.061178:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020905984 00000100:00100000:1.0:1788582191.061190:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020905984 00010000:00010000:1.0:1788582191.061255:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a7c6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7c63 expref: 13 pid: 14415 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582191.061302:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788582191.061312:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf374a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9415e791-1a3c-4924-bcfc-d6d86718d620+13:3308:x1875464020905984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788582191.061326:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582191.061332:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a7c6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7c63 expref: 13 pid: 14415 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582191.061345:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a7c6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7c63 expref: 13 pid: 14415 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582191.061378:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d88e27000/0x2bc3aa892c3a7c6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a7c63 expref: 13 pid: 14415 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582191.061394:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7c9b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582191.061401:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7c9b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788582191.061418:0:14405:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005230988s 00010000:00010000:1.0:1788582191.061422:0:14405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7c9b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582191.061428:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7c9b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582191.061434:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7c9b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582191.061440:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7c9b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582191.061463:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26e00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582191.061467:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7c9b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582191.061475:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7c9b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582191.061491:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7c9b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582191.061500:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788582191.061565:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf374a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9415e791-1a3c-4924-bcfc-d6d86718d620+12:3308:x1875464020905984:12345-0@lo:103:ldlm_bl.0 Request processed in 255us (2133us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582191.061573:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788582191.061819:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9415e791-1a3c-4924-bcfc-d6d86718d620:3308:1875464020905984:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788582191.061982:0:14436:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7c9b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582191.061991:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7c9b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582191.061997:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7c9b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582191.069169:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+11:14402:x1875464020905728:12345-0@lo:253:mount.lustre.0 Request processed in 77039us (77176us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582191.069185:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788582191.069587:0:14402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:14402:1875464020905728:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788582191.069605:0:14402:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788582191.069608:0:14402:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788582191.069610:0:14402:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788582191.069611:0:14402:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788582191.069612:0:14402:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788582191.069613:0:14402:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788582191.069614:0:14402:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788582191.069615:0:14402:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788582191.069629:0:14402:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788582191.069630:0:14402:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788582191.069632:0:14402:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788582191.069648:0:14402:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788582191.076564:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788582191.076738:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788582191.077084:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788582191.077425:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788582191.077842:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788582191.078004:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1788582191.079382:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1788582191.079638:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1788582191.079983:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1788582191.080199:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1788582191.080636:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1788582191.080884:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1788582191.132651:0:14402:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1788582191.133242:0:14402:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1788582191.133484:0:14459:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1788582191.133488:0:14459:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1788582191.133581:0:14460:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1788582191.133660:0:14460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788582191.137159:0:14460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788582191.137600:0:14460:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788582191.137605:0:14460:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1788582191.138966:0:14402:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788582191.139088:0:14402:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788582191.139961:0:14402:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788582191.139973:0:14402:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788582191.140139:0:14402:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788582191.142080:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788582191.143029:0:14402:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788582191.143086:0:14402:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1788582191.145080:0:14402:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:2.0:1788582191.151504:0:14402:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1788582191.187704:0:14402:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788582191.187760:0:14402:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffa64381d5f988 00100000:10000000:1.0:1788582191.187769:0:14402:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788582191.189030:0:14402:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788582191.189046:0:14402:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.112@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788582191.189061:0:14402:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788582191.189078:0:14402:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1788582191.534921:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788582191.730830:0:14417:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788582191.730839:0:14417:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d0dbbdde000 from 6 10000000:01000000:2.0:1788582191.730845:0:14417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788582191.730896:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05200/0x2bc3aa892c3a7ca2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582191.730908:0:14417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05200/0x2bc3aa892c3a7ca2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582191.730922:0:14417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05200/0x2bc3aa892c3a7ca2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582191.730949:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020906112:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788582191.731023:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582191.731077:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d97e5ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788582191.731171:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020906112 00000100:00100000:3.0:1788582191.731179:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020906112 00000100:00100000:3.0:1788582191.731252:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788582191.731262:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+11:14417:x1875464020906112:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788582191.731275:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582191.731289:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7ca9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a7ca2 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582191.731313:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7ca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7ca2 expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582191.731337:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7ca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7ca2 expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582191.731358:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e26e00, rc 0) 00000100:00100000:3.0:1788582191.731405:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+12:14417:x1875464020906112:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582191.731413:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788582191.731458:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020906112:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788582191.731472:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05200/0x2bc3aa892c3a7ca2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7ca9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582191.731481:0:14417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05200/0x2bc3aa892c3a7ca2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a7ca9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582191.731528:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020906240:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788582191.731555:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582191.731576:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da7194480 going to sleep for 11 seconds 00000100:00100000:3.0:1788582191.731588:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020906240 00000100:00100000:3.0:1788582191.731591:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020906240 00000100:00100000:3.0:1788582191.731610:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788582191.731616:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+12:14417:x1875464020906240:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788582191.731629:0:14414:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788582191.731644:0:14414:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788582191.731646:0:14414:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788582191.731714:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+12:14417:x1875464020906240:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 97us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582191.731728:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788582191.734433:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020906240:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788582191.734499:0:14417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788582191.734510:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05200/0x2bc3aa892c3a7ca2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7ca9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582191.734520:0:14417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05200/0x2bc3aa892c3a7ca2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7ca9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788582191.983283:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788582192.564119:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788582193.009032:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788582193.581521:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582194.606430:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582195.640402:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788582196.206223:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788582196.206231:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788582196.206234:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788582196.206238:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788582196.206241:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788582196.206244:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788582196.206249:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d0db7748000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788582196.206261:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d0db7748000 using connection 192.168.201.112@tcp/0@lo 00000100:00100000:1.0:1788582196.206295:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0dbbdc3480 x1875464020906496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788582196.206326:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788582196.206341:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9415e791-1a3c-4924-bcfc-d6d86718d620:3308:1875464020906368:0@lo:400:kworker.0 00000100:00100000:1.0:1788582196.206410:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582196.206465:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875464020906496:0@lo:38:kworker.0 00000100:00100000:1.0:1788582196.206495:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582196.206535:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020906496 00000100:00100000:1.0:1788582196.206542:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020906496 00000100:00100000:1.0:1788582196.206575:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788582196.206582:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3305:x1875464020906496:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788582196.206619:0:14422:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 415 last 0 00000020:00000080:1.0:1788582196.206655:0:14422:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x2bc3aa892c3a7cb0 00000004:00100000:1.0:1788582196.206671:0:14422:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788582196.206838:0:14422:0:(import.c:65:import_set_state_nolock()) ffff8d0d85ba0800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788582196.206888:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1875464020906496:12345-0@lo:38:kworker.0 Request processed in 305us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582196.206896:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788582196.206936:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d0dbbdc3480 x1875464020906496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788582206 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788582196.206949:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788582196.206955:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788582196.206959:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788582196.206961:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0db7748000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788582196.206966:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3305:1875464020906496:0@lo:38:kworker.0 00000100:00100000:2.0:1788582196.207402:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020906368 00000100:00100000:2.0:1788582196.207407:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020906368 00000100:00100000:2.0:1788582196.207440:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788582196.207448:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+12:3308:x1875464020906368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582196.207488:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+12:3308:x1875464020906368:12345-0@lo:400:kworker.0 Request processed in 42us (1078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582196.207506:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788582196.207546:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9415e791-1a3c-4924-bcfc-d6d86718d620:3308:1875464020906368:0@lo:400:kworker.0 00000001:02000400:0.0:1788582196.584629:0:14703:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg112-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788582196.653429:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582197.677747:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582198.711918:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788582199.395957:0:14853:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc26975cc0 20000000:00000080:2.0:1788582199.395973:0:14853:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d0dae6e9000 uarg=0000000000000000 20000000:01000000:2.0:1788582199.396001:0:14853:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788582199.396007:0:14853:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788582199.396011:0:14853:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788582199.396904:0:14854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1788582199.397129:0:14853:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788582199.409709:0:14853:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788582199.409830:0:14853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a7cb7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582199.409852:0:14853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7c78 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7c71 expref: 11 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582199.409860:0:14853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a7cb7 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582199.409907:0:14853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7c78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a7c71 expref: 11 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582199.409923:0:14853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7c78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7c71 expref: 11 pid: 14413 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582199.409938:0:14853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14853:1875464020906624:0@lo:104: 00000100:00100000:0.0:1788582199.410004:0:14853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582199.410065:0:14853:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d917d9c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788582199.410376:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020906624 00000100:00100000:1.0:1788582199.410384:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020906624 00000100:00100000:1.0:1788582199.410443:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788582199.410453:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf375880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9415e791-1a3c-4924-bcfc-d6d86718d620+3:14853:x1875464020906624:12345-0@lo:104: 00010000:00010000:1.0:1788582199.410467:0:14404:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0da71fd800/0x2bc3aa892c3a7c71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a7c78 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582199.410536:0:14404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788582199.410542:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf375880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9415e791-1a3c-4924-bcfc-d6d86718d620+3:14853:x1875464020906624:12345-0@lo:104: Request processed in 92us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582199.410548:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788582199.410557:0:14853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14853:1875464020906624:0@lo:104: 00010000:00010000:0.0:1788582199.410577:0:14853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a7cb7 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582199.410712:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582199.410720:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0da71fd800/0x2bc3aa892c3a7c71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a7c78 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582199.410728:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd800 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:2.0:1788582199.410731:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0da71fd800/0x2bc3aa892c3a7c71 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a7c78 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582199.410740:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0da71fd800/0x2bc3aa892c3a7c71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a7c78 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788582199.410747:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0da71fd800/0x2bc3aa892c3a7c71 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a7c78 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788582199.410754:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788582199.411088:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0da71fd800/0x2bc3aa892c3a7c71 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a7c78 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582199.411096:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788582199.411133:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0da71fd800/0x2bc3aa892c3a7c71 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a7c78 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582199.411139:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0da71fd800/0x2bc3aa892c3a7c71 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a7c78 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582199.411155:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582199.411157:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582199.411159:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582199.411249:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaeaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9415e791-1a3c-4924-bcfc-d6d86718d620:3306:1875464020906752:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788582199.411283:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582199.411399:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020906752 00000100:00100000:2.0:1788582199.411406:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020906752 00010000:00010000:2.0:1788582199.411427:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7c78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7c71 expref: 12 pid: 14413 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582199.411457:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788582199.411465:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9415e791-1a3c-4924-bcfc-d6d86718d620+12:3306:x1875464020906752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788582199.411476:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582199.411481:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7c78 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7c71 expref: 12 pid: 14413 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582199.411492:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7c78 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7c71 expref: 12 pid: 14413 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582199.411505:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7c78 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a7c71 expref: 12 pid: 14413 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582199.411518:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a7cb7 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582199.411527:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a7cb7 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582199.411551:0:14405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a7cb7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582199.411558:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a7cb7 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582199.411564:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a7cb7 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582199.411569:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a7cb7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582199.411574:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089000 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582199.411577:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a7cb7 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582199.411585:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a7cb7 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582199.412021:0:14853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a7cb7 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582199.412030:0:14853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a7cb7 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582199.413099:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a7cb7 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582199.413112:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0da7089000/0x2bc3aa892c3a7cb7 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582199.413128:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582199.413274:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9415e791-1a3c-4924-bcfc-d6d86718d620+11:3306:x1875464020906752:12345-0@lo:103:ldlm_bl.0 Request processed in 1808us (1988us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582199.413284:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788582199.413471:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaeaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9415e791-1a3c-4924-bcfc-d6d86718d620:3306:1875464020906752:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788582199.726983:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582200.302280:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788582190/real 1788582190] req@ffff8d0dbaea8380 x1875464020903808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788582200 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582200.302797:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d0dbaea8380 x1875464020903808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788582200 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582200.302809:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788582190/real 1788582190] req@ffff8d0dbbdc2680 x1875464020903680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788582200 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582200.302824:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d0dbbdc2680 x1875464020903680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788582200 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788582200.302844:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0da7180000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788582200.303399:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788582200.303407:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020903808:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788582200.303415:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0dbbd46000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788582200.310453:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788582200.310460:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788582200.310464:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d0dbbd46000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788582200.310473:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 409 00000100:00080000:1.0:1788582200.310479:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788582200.310486:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d0dbbd46000 using connection 192.168.201.112@tcp/0@lo 00000100:00100000:1.0:1788582200.310514:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0dbbdc2a00 x1875464020907008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788582200.310528:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788582200.310531:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788582200.310533:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d0da7180000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788582200.310536:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 409 00000100:00080000:1.0:1788582200.310539:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788582200.310542:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d0da7180000 using connection 192.168.201.112@tcp/0@lo 00000100:00100000:1.0:1788582200.310553:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0dbbdc1500 x1875464020907136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788582200.310598:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788582200.310614:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9415e791-1a3c-4924-bcfc-d6d86718d620:3306:1875464020906880:0@lo:400:kworker.0 00000100:00100000:1.0:1788582200.310688:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582200.310784:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020906880 00000100:00100000:3.0:1788582200.310792:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020906880 00000100:00100000:3.0:1788582200.310860:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788582200.310870:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+11:3306:x1875464020906880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582200.310926:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+11:3306:x1875464020906880:12345-0@lo:400:kworker.0 Request processed in 58us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582200.310935:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788582200.310982:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9415e791-1a3c-4924-bcfc-d6d86718d620:3306:1875464020906880:0@lo:400:kworker.0 00000100:00100000:3.0:1788582200.311338:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788582200.311349:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875464020907264:0@lo:400:kworker.0 00000100:00100000:3.0:1788582200.311383:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582200.311572:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020907264 00000100:00100000:3.0:1788582200.311577:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020907264 00000100:00100000:3.0:1788582200.311605:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788582200.311611:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875464020907264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582200.311647:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875464020907264:12345-0@lo:400:kworker.0 Request processed in 36us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582200.311659:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788582200.311688:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d0dbbdc2d80 x1875464020907264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788582216 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788582200.311700:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875464020907264:0@lo:400:kworker.0 00000100:00080000:2.0:1788582200.317741:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788582200.317752:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020903680:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1788582200.317896:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020907008:0@lo:8:kworker.0 00000400:00000100:3.0:1788582200.317965:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875464020907008 offset 0 length 520: 4 00000100:00100000:3.0:1788582200.318895:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020907136:0@lo:8:kworker.0 00000400:00000100:3.0:1788582200.318938:0:3305:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875464020907136 offset 0 length 520: 4 00010000:00010000:2.0:1788582200.751309:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788582201.264336:0:14417:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788582201.264344:0:14417:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0dbbdde000 from 10 10000000:01000000:3.0:1788582201.264351:0:14417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788582201.264396:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26a00/0x2bc3aa892c3a7cbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582201.264408:0:14417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26a00/0x2bc3aa892c3a7cbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582201.264421:0:14417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26a00/0x2bc3aa892c3a7cbe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582201.264446:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020907392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788582201.264512:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582201.264566:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d97e5c240 going to sleep for 11 seconds 00000100:00100000:2.0:1788582201.264680:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020907392 00000100:00100000:2.0:1788582201.264688:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020907392 00000100:00100000:2.0:1788582201.264742:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788582201.264760:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+11:14417:x1875464020907392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788582201.264781:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582201.264795:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0dbbe04400/0x2bc3aa892c3a7cc5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a7cbe expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582201.264819:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0dbbe04400/0x2bc3aa892c3a7cc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7cbe expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582201.264841:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0dbbe04400/0x2bc3aa892c3a7cc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7cbe expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582201.264850:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04400, rc 0) 00000100:00100000:2.0:1788582201.264894:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+12:14417:x1875464020907392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582201.264901:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788582201.264944:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020907392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788582201.264957:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26a00/0x2bc3aa892c3a7cbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7cc5 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582201.264965:0:14417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26a00/0x2bc3aa892c3a7cbe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a7cc5 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582201.265015:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020907520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788582201.265038:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582201.265059:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dba8d8e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788582201.265926:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020907520 00000100:00100000:3.0:1788582201.265944:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020907520 00000100:00100000:3.0:1788582201.267968:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788582201.267988:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+12:14417:x1875464020907520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788582201.268324:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+12:14417:x1875464020907520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 344us (3283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582201.268332:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788582201.268393:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020907520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788582201.268443:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020907648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788582201.268486:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582201.268515:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d97e5c540 going to sleep for 11 seconds 00000100:00100000:3.0:1788582201.268527:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020907648 00000100:00100000:3.0:1788582201.268533:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020907648 00000100:00100000:3.0:1788582201.268552:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788582201.268558:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+12:14417:x1875464020907648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788582201.274662:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+12:14417:x1875464020907648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 6094us (6166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582201.274675:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788582201.276755:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020907648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788582201.279369:0:14929:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788582201.280678:0:14417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788582201.280710:0:14417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788582201.280722:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26a00/0x2bc3aa892c3a7cbe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7cc5 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582201.280735:0:14417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26a00/0x2bc3aa892c3a7cbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7cc5 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582201.786544:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582202.797378:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788582203.245853:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788582203.821361:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788582204.453551:0:15103:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788582204.453555:0:15103:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788582204.454300:0:15103:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d0dbfa13000 00000020:01000004:3.0:1788582204.454323:0:15103:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788582204.454339:0:15103:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788582204.454357:0:15103:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d0d97e98000) 00000020:00000080:3.0:1788582204.454375:0:15103:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788582204.474666:0:15103:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788582204.475019:0:15103:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788582204.476089:0:15103:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788582204.476493:0:15103:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788582204.476835:0:15103:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788582204.477399:0:15103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 579: rc = 0 00100000:10000000:2.0:1788582204.477489:0:15103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 579: rc = 0 00100000:10000000:2.0:1788582204.477672:0:15103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 579: rc = 0 00100000:10000000:2.0:1788582204.478424:0:15103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 433: rc = 0 00100000:10000000:2.0:1788582204.478778:0:15103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 433: rc = 0 00100000:10000000:2.0:1788582204.479112:0:15103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 433: rc = 0 00100000:10000000:2.0:1788582204.479608:0:15103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 433: rc = 0 00100000:10000000:2.0:1788582204.479857:0:15103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 433: rc = 0 00100000:10000000:2.0:1788582204.480367:0:15103:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 433: rc = 0 00000020:00000080:2.0:1788582204.481194:0:15103:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788582204.481232:0:15103:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788582204.481244:0:15103:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2bc3aa892c3a7cd3 00000020:01000004:2.0:1788582204.481253:0:15103:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1788582204.481276:0:15103:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.112@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788582204.481279:0:15103:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788582204.481285:0:15103:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788582204.481290:0:15103:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788582204.481300:0:15103:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d0dae440000) 00000020:00000080:2.0:1788582204.481310:0:15103:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1788582204.483105:0:15103:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788582204.484100:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788582204.484108:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1788582204.497281:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1788582204.497300:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1788582204.500435:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1788582204.500449:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1788582204.505887:0:15103:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788582204.506461:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788582204.506477:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788582204.507752:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788582204.507766:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788582204.533752:0:15103:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788582204.536458:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788582204.536472:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788582204.538626:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788582204.538639:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788582204.540018:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788582204.540030:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788582204.544585:0:15103:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788582204.545556:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1788582204.545563:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788582204.547449:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788582204.547592:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788582204.589007:0:15103:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788582204.589706:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788582204.589714:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788582204.591023:0:15103:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788582204.591036:0:15103:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1788582204.591792:0:15103:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1788582204.591816:0:15103:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1788582204.591822:0:15103:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.112@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788582204.609406:0:15103:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.112@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788582204.609441:0:15103:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.112@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788582204.609448:0:15103:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788582204.609450:0:15103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788582204.609451:0:15103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788582204.609452:0:15103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788582204.609453:0:15103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788582204.609454:0:15103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788582204.609456:0:15103:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788582204.609457:0:15103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788582204.609458:0:15103:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788582204.609461:0:15103:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788582204.609463:0:15103:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788582204.609465:0:15103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788582204.609466:0:15103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788582204.609467:0:15103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788582204.609468:0:15103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788582204.609469:0:15103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788582204.609469:0:15103:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788582204.609470:0:15103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788582204.609471:0:15103:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788582204.609495:0:15103:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788582204.609577:0:15103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020907776:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788582204.609646:0:15103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582204.609741:0:15103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d869890c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788582204.609787:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020907776 00000100:00100000:2.0:1788582204.609800:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020907776 00000100:00100000:2.0:1788582204.610024:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788582204.610035:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+12:15103:x1875464020907776:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788582204.610064:0:14414:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788582204.610067:0:14414:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1788582204.610071:0:14414:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788582204.617432:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+12:15103:x1875464020907776:12345-0@lo:253:mount.lustre.0 Request processed in 7391us (7776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582204.617446:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788582204.617738:0:15103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020907776:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788582204.617756:0:15103:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788582204.617760:0:15103:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788582204.617762:0:15103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788582204.617764:0:15103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788582204.617765:0:15103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788582204.617766:0:15103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788582204.617768:0:15103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788582204.617769:0:15103:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788582204.617771:0:15103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788582204.617772:0:15103:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788582204.618097:0:15103:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d0dbfa13000 from lustre-OST0000 10000000:01000000:3.0:1788582204.618144:0:15103:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788582204.618147:0:15103:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788582204.618154:0:15103:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d0dbf4e0000 local copy 00010000:00010000:3.0:1788582204.618165:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da71fcc00/0x2bc3aa892c3a7bc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7bd0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582204.618436:0:15103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020907904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788582204.618484:0:15103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582204.618529:0:15103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85874840 going to sleep for 11 seconds 00000100:00100000:2.0:1788582204.618708:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020907904 00000100:00100000:2.0:1788582204.618715:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020907904 00000100:00100000:2.0:1788582204.618759:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788582204.618768:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+12:15103:x1875464020907904:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788582204.618940:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+12:15103:x1875464020907904:12345-0@lo:501:mount.lustre.0 Request processed in 172us (455us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788582204.618948:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788582204.619137:0:15103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020907904:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788582204.619153:0:15103:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788582204.619321:0:15103:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788582204.619329:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da71fcc00/0x2bc3aa892c3a7bc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7bd0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.619338:0:15103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0da71fcc00/0x2bc3aa892c3a7bc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7bd0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788582204.619359:0:15103:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d0dbfa13000 10000000:01000000:3.0:1788582204.619364:0:15103:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788582204.619369:0:15103:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d0dbf4e0000 10000000:01000000:3.0:1788582204.619371:0:15103:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788582204.619374:0:15103:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d0dbf4e0000 from 1 10000000:01000000:3.0:1788582204.619377:0:15103:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788582204.619400:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26600/0x2bc3aa892c3a7ce1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.619409:0:15103:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26600/0x2bc3aa892c3a7ce1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.619418:0:15103:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26600/0x2bc3aa892c3a7ce1 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582204.619433:0:15103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020908032:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788582204.619460:0:15103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582204.619494:0:15103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d85874840 going to sleep for 11 seconds 00000100:00100000:2.0:1788582204.619677:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020908032 00000100:00100000:2.0:1788582204.619682:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020908032 00000100:00100000:2.0:1788582204.619714:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788582204.619722:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+12:15103:x1875464020908032:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788582204.619730:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582204.619742:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7ce8 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a7ce1 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582204.619767:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7ce8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7ce1 expref: 13 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582204.619775:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0dbbe04a00/0x2bc3aa892c3a7ce8 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7ce1 expref: 13 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582204.619783:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04a00, rc 0) 00000100:00100000:2.0:1788582204.619814:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+13:15103:x1875464020908032:12345-0@lo:101:mount.lustre.0 Request processed in 93us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582204.619820:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788582204.620003:0:15103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020908032:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788582204.620016:0:15103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26600/0x2bc3aa892c3a7ce1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7ce8 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582204.620026:0:15103:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26600/0x2bc3aa892c3a7ce1 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a7ce8 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788582204.620042:0:15103:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788582204.620069:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26600/0x2bc3aa892c3a7ce1 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7ce8 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582204.620076:0:15103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26600/0x2bc3aa892c3a7ce1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7ce8 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788582204.620083:0:15103:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788582204.620087:0:15103:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788582204.620091:0:15103:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788582204.620093:0:15103:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788582204.620118:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7088c00/0x2bc3aa892c3a7cef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582204.620134:0:15103:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0da7088c00/0x2bc3aa892c3a7cef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582204.620141:0:15103:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0da7088c00/0x2bc3aa892c3a7cef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582204.620154:0:15103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020908160:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788582204.620182:0:15103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582204.620234:0:15103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbbc69000 going to sleep for 11 seconds 00000100:00100000:2.0:1788582204.620348:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020908160 00000100:00100000:2.0:1788582204.620353:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020908160 00000100:00100000:2.0:1788582204.620376:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788582204.620382:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+13:15103:x1875464020908160:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788582204.620388:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582204.620397:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0dbbe04c00/0x2bc3aa892c3a7cf6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a7cef expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582204.620410:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0dbbe04c00/0x2bc3aa892c3a7cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7cef expref: 14 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582204.620418:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0dbbe04c00/0x2bc3aa892c3a7cf6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7cef expref: 14 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582204.620425:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04c00, rc 0) 00000100:00100000:2.0:1788582204.620451:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+14:15103:x1875464020908160:12345-0@lo:101:mount.lustre.0 Request processed in 69us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582204.620457:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788582204.620671:0:15103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020908160:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788582204.620682:0:15103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0da7088c00/0x2bc3aa892c3a7cef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7cf6 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582204.620690:0:15103:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0da7088c00/0x2bc3aa892c3a7cef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a7cf6 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788582204.621454:0:15103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1788582204.622761:0:15103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788582204.625013:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1788582204.625185:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1788582204.625379:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1788582204.625448:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1788582204.625487:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1788582204.625594:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1788582204.625680:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1788582204.625689:0:15103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1788582204.625793:0:15103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020908288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788582204.625862:0:15103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582204.626087:0:15103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbf93ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788582204.626317:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020908288 00000100:00100000:2.0:1788582204.626324:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020908288 00000100:00100000:2.0:1788582204.626366:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788582204.626376:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+14:15103:x1875464020908288:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788582204.626864:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+14:15103:x1875464020908288:12345-0@lo:501:mount.lustre.0 Request processed in 488us (1000us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582204.626872:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788582204.627403:0:15103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc2680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020908288:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788582204.627443:0:15103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020908416:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788582204.627480:0:15103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582204.627508:0:15103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbbc69e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788582204.627596:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020908416 00000100:00100000:2.0:1788582204.627602:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020908416 00000100:00100000:2.0:1788582204.627641:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788582204.627649:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+14:15103:x1875464020908416:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788582204.629392:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+14:15103:x1875464020908416:12345-0@lo:503:mount.lustre.0 Request processed in 1735us (1902us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582204.629406:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788582204.629724:0:15103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020908416:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788582204.630700:0:15103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788582204.630781:0:15103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020908544:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788582204.630845:0:15103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582204.630883:0:15103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbbc69e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788582204.631058:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020908544 00000100:00100000:2.0:1788582204.631065:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020908544 00000100:00100000:2.0:1788582204.631128:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788582204.631139:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+14:15103:x1875464020908544:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788582204.631392:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+14:15103:x1875464020908544:12345-0@lo:502:mount.lustre.0 Request processed in 254us (546us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582204.631400:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788582204.632511:0:15103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020908544:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788582204.632764:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788582204.632806:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788582204.632823:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788582204.632858:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788582204.632896:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788582204.634369:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788582204.634465:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788582204.634489:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788582204.634506:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788582204.634548:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788582204.634602:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788582204.634645:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788582204.634694:0:15103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020908672:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788582204.634757:0:15103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582204.634798:0:15103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbbc69e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788582204.634817:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020908672 00000100:00100000:2.0:1788582204.634825:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020908672 00000100:00100000:2.0:1788582204.635093:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788582204.635104:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+14:15103:x1875464020908672:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788582204.635346:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+14:15103:x1875464020908672:12345-0@lo:502:mount.lustre.0 Request processed in 243us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582204.635365:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788582204.635541:0:15103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020908672:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788582204.635619:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788582204.635636:0:15103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1788582204.639308:0:15117:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788582204.639320:0:15117:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788582204.639327:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788582204.639329:0:15117:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788582204.639334:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788582204.639351:0:15117:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d0d9dde8000) 00000020:00000080:1.0:1788582204.639373:0:15117:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788582204.639381:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788582204.639475:0:15117:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d0dbfa13000 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788582204.639484:0:15117:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788582204.639491:0:15117:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x2bc3aa892c3a7d04 00010000:00010000:1.0:1788582204.643503:0:15117:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1788582204.644109:0:15117:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788582204.647141:0:15117:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788582204.651856:0:15117:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788582204.651870:0:15117:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788582204.651878:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788582204.651880:0:15117:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788582204.651883:0:15117:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788582204.651886:0:15117:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1788582204.651887:0:15117:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788582204.651889:0:15117:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788582204.651890:0:15117:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788582204.651892:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788582204.651894:0:15117:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788582204.651896:0:15117:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788582204.651899:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788582204.651900:0:15117:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788582204.651902:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788582204.651904:0:15117:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788582204.651906:0:15117:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788582204.651908:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788582204.651909:0:15117:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788582204.651911:0:15117:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788582204.651913:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788582204.651914:0:15117:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788582204.651926:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788582204.651988:0:15117:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788582204.651991:0:15117:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788582204.651992:0:15117:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788582204.651995:0:15117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788582204.655476:0:15103:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788582204.655516:0:15103:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788582204.655538:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7088c00/0x2bc3aa892c3a7cef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7cf6 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582204.655550:0:15103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0da7088c00/0x2bc3aa892c3a7cef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7cf6 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788582204.655557:0:15103:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0dbfa13000 from 1 10000000:01000000:0.0:1788582204.655560:0:15103:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788582204.655594:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7088200/0x2bc3aa892c3a7d0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582204.655601:0:15103:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0da7088200/0x2bc3aa892c3a7d0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582204.655612:0:15103:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0da7088200/0x2bc3aa892c3a7d0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582204.655635:0:15103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020908800:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788582204.655696:0:15103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582204.655730:0:15103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbbc69e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788582204.655798:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020908800 00000100:00100000:3.0:1788582204.655806:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020908800 00000100:00100000:3.0:1788582204.655881:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788582204.655891:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+14:15103:x1875464020908800:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788582204.655903:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582204.655914:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d88e27e00/0x2bc3aa892c3a7d12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a7d0b expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.655943:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d88e27e00/0x2bc3aa892c3a7d12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7d0b expref: 15 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.655954:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d88e27e00/0x2bc3aa892c3a7d12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7d0b expref: 15 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.655963:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27e00, rc 0) 00000100:00100000:3.0:1788582204.655998:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+15:15103:x1875464020908800:12345-0@lo:101:mount.lustre.0 Request processed in 108us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582204.656004:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788582204.656196:0:15103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020908800:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788582204.656226:0:15103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0da7088200/0x2bc3aa892c3a7d0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7d12 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582204.656235:0:15103:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0da7088200/0x2bc3aa892c3a7d0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a7d12 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788582204.656703:0:15103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788582204.657504:0:15103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788582204.657708:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788582204.657744:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788582204.657794:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788582204.657802:0:15103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788582204.657993:0:15103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020908928:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788582204.658040:0:15103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582204.658087:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020908928 00000100:00100000:0.0:1788582204.658093:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020908928 00000100:00100000:0.0:1788582204.658137:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788582204.658145:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+15:15103:x1875464020908928:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788582204.658332:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+15:15103:x1875464020908928:12345-0@lo:501:mount.lustre.0 Request processed in 187us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582204.658339:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788582204.658379:0:15103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbbc69e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788582204.658396:0:15103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020908928:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788582204.658418:0:15103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020909056:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788582204.658451:0:15103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582204.658468:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020909056 00000100:00100000:0.0:1788582204.658471:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020909056 00000100:00100000:0.0:1788582204.658488:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788582204.658494:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+15:15103:x1875464020909056:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788582204.658600:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+15:15103:x1875464020909056:12345-0@lo:503:mount.lustre.0 Request processed in 106us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582204.658614:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788582204.658641:0:15103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbbc69e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788582204.658652:0:15103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020909056:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788582204.659187:0:15103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788582204.659253:0:15103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020909184:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788582204.659288:0:15103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582204.659311:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020909184 00000100:00100000:0.0:1788582204.659316:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020909184 00000100:00100000:0.0:1788582204.659339:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788582204.659346:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+15:15103:x1875464020909184:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788582204.659479:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+15:15103:x1875464020909184:12345-0@lo:502:mount.lustre.0 Request processed in 133us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582204.659486:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788582204.659517:0:15103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbbc69e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788582204.659529:0:15103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020909184:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788582204.659740:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788582204.659786:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788582204.659987:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788582204.660041:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788582204.660089:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788582204.660154:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788582204.660194:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788582204.660249:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788582204.660277:0:15103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020909312:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788582204.660315:0:15103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582204.660327:0:15103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbbc69e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788582204.661742:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020909312 00000100:00100000:3.0:1788582204.661754:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020909312 00000100:00100000:3.0:1788582204.661801:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788582204.661810:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+15:15103:x1875464020909312:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788582204.662047:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+15:15103:x1875464020909312:12345-0@lo:502:mount.lustre.0 Request processed in 237us (1731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582204.662055:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788582204.662276:0:15103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020909312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788582204.663351:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1788582204.663369:0:15103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1788582204.669517:0:15121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788582204.669534:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788582204.669537:0:15121:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788582204.669545:0:15121:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d0dbfa13000 00000020:00000080:2.0:1788582204.669548:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788582204.669555:0:15121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788582204.669557:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788582204.669558:0:15121:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788582204.669561:0:15121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788582204.669563:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788582204.669564:0:15121:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788582204.669567:0:15121:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d0dbfa13000 00000020:00000080:2.0:1788582204.669569:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788582204.669616:0:15121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788582204.672680:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788582204.672688:0:15121:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788582204.672701:0:15121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788582204.672708:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788582204.672709:0:15121:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788582204.672715:0:15121:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d0dbfa13000 00000020:00000080:2.0:1788582204.672717:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788582204.678030:0:15121:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788582204.678054:0:15121:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788582204.678056:0:15121:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788582204.678061:0:15121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1788582204.679103:0:15103:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788582204.679147:0:15103:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788582204.682187:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da7088200/0x2bc3aa892c3a7d0b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7d12 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.682224:0:15103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0da7088200/0x2bc3aa892c3a7d0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7d12 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788582204.682289:0:15103:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788582204.682293:0:15103:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d0dbfa13000 10000000:01000000:3.0:1788582204.682296:0:15103:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d0dbfa13000 10000000:01000000:3.0:1788582204.682300:0:15103:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788582204.682306:0:15103:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0dbfa13000 from 1 10000000:01000000:3.0:1788582204.682309:0:15103:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788582204.682344:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a7d19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.682353:0:15103:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a7d19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.682363:0:15103:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a7d19 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582204.682386:0:15103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020909440:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788582204.682455:0:15103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582204.682507:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020909440 00000100:00100000:3.0:1788582204.682514:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020909440 00000100:00100000:3.0:1788582204.682557:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788582204.682566:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+15:15103:x1875464020909440:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788582204.682580:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582204.682592:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d88e27400/0x2bc3aa892c3a7d20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a7d19 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.682626:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d88e27400/0x2bc3aa892c3a7d20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7d19 expref: 16 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.682637:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d88e27400/0x2bc3aa892c3a7d20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7d19 expref: 16 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.682647:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27400, rc 0) 00000100:00100000:3.0:1788582204.682681:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+16:15103:x1875464020909440:12345-0@lo:101:mount.lustre.0 Request processed in 115us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582204.682688:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788582204.682733:0:15103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788582204.682754:0:15103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020909440:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788582204.682769:0:15103:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a7d19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7d20 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.682778:0:15103:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a7d19 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a7d20 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788582204.684591:0:15103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1788582204.685340:0:15103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788582204.685582:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1788582204.685624:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1788582204.685656:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1788582204.685702:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1788582204.685736:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1788582204.685780:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1788582204.685813:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1788582204.685844:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1788582204.685913:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1788582204.686077:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1788582204.686113:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1788582204.686186:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1788582204.686252:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1788582204.686286:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1788582204.686331:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1788582204.686366:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1788582204.686399:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1788582204.686441:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1788582204.686474:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1788582204.686508:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1788582204.686556:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1788582204.686591:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1788582204.686623:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1788582204.686669:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1788582204.686719:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1788582204.686751:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1788582204.686799:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1788582204.686832:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1788582204.686904:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1788582204.686911:0:15103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1788582204.687177:0:15103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020909568:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788582204.687340:0:15103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582204.687384:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020909568 00000100:00100000:3.0:1788582204.687392:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020909568 00000100:00100000:3.0:1788582204.687430:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788582204.687438:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+16:15103:x1875464020909568:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788582204.687643:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+16:15103:x1875464020909568:12345-0@lo:501:mount.lustre.0 Request processed in 204us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582204.687650:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788582204.687699:0:15103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788582204.687719:0:15103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020909568:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788582204.687749:0:15103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020909696:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788582204.687785:0:15103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582204.687806:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020909696 00000100:00100000:3.0:1788582204.687809:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020909696 00000100:00100000:3.0:1788582204.687828:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788582204.687834:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+16:15103:x1875464020909696:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788582204.690463:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+16:15103:x1875464020909696:12345-0@lo:503:mount.lustre.0 Request processed in 2618us (2668us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582204.690478:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788582204.690559:0:15103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788582204.690583:0:15103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020909696:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788582204.692194:0:15103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788582204.692381:0:15103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020909824:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788582204.692447:0:15103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582204.692495:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020909824 00000100:00100000:3.0:1788582204.692502:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020909824 00000100:00100000:3.0:1788582204.692542:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788582204.692551:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+16:15103:x1875464020909824:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788582204.692750:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+16:15103:x1875464020909824:12345-0@lo:502:mount.lustre.0 Request processed in 199us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582204.692758:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788582204.692806:0:15103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788582204.692827:0:15103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020909824:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788582204.694803:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788582204.694881:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788582204.694916:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788582204.694960:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788582204.694996:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788582204.695046:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788582204.695082:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788582204.695113:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788582204.695187:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788582204.695243:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788582204.695278:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788582204.695327:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788582204.695363:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788582204.695393:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788582204.695436:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788582204.695470:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788582204.695504:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788582204.695551:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788582204.695586:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788582204.695616:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788582204.695663:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788582204.695699:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788582204.695730:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788582204.695776:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788582204.695826:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1788582204.695862:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1788582204.695907:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1788582204.695940:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1788582204.695971:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1788582204.696028:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1788582204.696066:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1788582204.696100:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1788582204.696317:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1788582204.696368:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1788582204.696403:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1788582204.696461:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1788582204.696500:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1788582204.696532:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1788582204.696576:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1788582204.696608:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1788582204.696660:0:15103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020909952:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788582204.696738:0:15103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582204.696792:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020909952 00000100:00100000:3.0:1788582204.696800:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020909952 00000100:00100000:3.0:1788582204.696848:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788582204.696857:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+16:15103:x1875464020909952:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788582204.697066:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+16:15103:x1875464020909952:12345-0@lo:502:mount.lustre.0 Request processed in 210us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582204.697073:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788582204.697145:0:15103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c3600 going to sleep for 11 seconds 00000100:00100000:3.0:1788582204.697168:0:15103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020909952:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788582204.697259:0:15103:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788582204.697269:0:15103:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788582204.699461:0:15125:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788582204.699478:0:15125:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d0d97e999b8) 00000020:00000080:3.0:1788582204.699499:0:15125:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1788582204.699583:0:15125:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d0dbfa13000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788582204.699587:0:15125:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d0dbfa13000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788582204.699590:0:15125:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0dbfa13000 3 00010000:00080000:3.0:1788582204.699621:0:15125:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d0d9d9ba000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.112@tcp at head 00010000:00010000:3.0:1788582204.704011:0:15125:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1788582204.704701:0:15125:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788582204.704741:0:15125:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788582204.704754:0:15125:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x2bc3aa892c3a7d2e 00000100:00080000:3.0:1788582204.704765:0:15125:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788582204.704772:0:15125:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d0d9d9ba000 using connection 192.168.201.112@tcp/0@lo 00000100:00100000:3.0:1788582204.704814:0:15125:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0dac0c1c00 x1875464020910080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788582204.704846:0:15125:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788582204.708282:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875464020910080:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788582204.708363:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788582204.708424:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788582204.708429:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788582204.708437:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788582204.708440:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788582204.708499:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020910080 00000100:00100000:2.0:1788582204.708577:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020910080 00000100:00100000:2.0:1788582204.708688:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788582204.708696:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3305:x1875464020910080:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788582204.708725:0:14420:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 423 last 0 00000020:00000080:2.0:1788582204.708763:0:14420:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x2bc3aa892c3a7d35 00000004:00100000:2.0:1788582204.708778:0:14420:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788582204.708810:0:14420:0:(import.c:65:import_set_state_nolock()) ffff8d0d90c1e800 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1788582204.709965:0:15125:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1788582204.710029:0:15103:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1788582204.710061:0:15103:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788582204.710075:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a7d19 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7d20 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.710087:0:15103:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27600/0x2bc3aa892c3a7d19 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7d20 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788582204.710148:0:15103:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788582204.710151:0:15103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788582204.710152:0:15103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788582204.710153:0:15103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788582204.710155:0:15103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788582204.710156:0:15103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788582204.710157:0:15103:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788582204.710159:0:15103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788582204.710160:0:15103:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788582204.710164:0:15103:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1788582204.710166:0:15103:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788582204.710168:0:15103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788582204.710169:0:15103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788582204.710170:0:15103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788582204.710171:0:15103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788582204.710172:0:15103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788582204.710178:0:15103:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788582204.710178:0:15103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788582204.710179:0:15103:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788582204.710224:0:15103:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788582204.710247:0:15103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020910336:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788582204.710312:0:15103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582204.710347:0:15103:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da78c3900 going to sleep for 11 seconds 00000100:00100000:3.0:1788582204.710370:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020910336 00000100:00100000:3.0:1788582204.710377:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020910336 00000100:00100000:3.0:1788582204.710422:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788582204.710430:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+16:15103:x1875464020910336:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788582204.710458:0:14415:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788582204.710473:0:14415:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788582204.710907:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1875464020910080:12345-0@lo:38:llog_process_th.0 Request processed in 2208us (2542us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582204.710917:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788582204.710950:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875464020910208:0@lo:400:kworker.0 00000100:00100000:2.0:1788582204.710992:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582204.711434:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020910208 00000100:00100000:2.0:1788582204.711440:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020910208 00000100:00100000:2.0:1788582204.711483:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788582204.711490:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875464020910208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582204.711536:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaeaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875464020910208:12345-0@lo:400:kworker.0 Request processed in 46us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582204.711542:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788582204.711592:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d0dbaea8000 x1875464020910208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788582220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582204.711605:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875464020910208:0@lo:400:kworker.0 00010000:00080000:2.0:1788582204.711648:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d0dac0c1c00 x1875464020910080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788582214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582204.711657:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788582204.711666:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788582204.711674:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788582204.711679:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788582204.711682:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0d9d9ba000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788582204.711689:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3305:1875464020910080:0@lo:38:llog_process_th.0 20000000:01000000:0.0:1788582204.738276:0:14415:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788582204.738290:0:14415:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1788582204.738311:0:14436:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788582204.738316:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788582204.738337:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a7d3c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582204.738356:0:14436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7ca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7ca2 expref: 16 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582204.738365:0:14436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a7d3c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582204.738403:0:14436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7ca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a7ca2 expref: 16 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582204.738417:0:14436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7ca9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7ca2 expref: 16 pid: 14415 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582204.738431:0:14436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf377480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14436:1875464020910464:0@lo:104: 00000100:00100000:0.0:1788582204.738490:0:14436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582204.738537:0:14436:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dbbc69240 going to sleep for 11 seconds 00000100:00100000:2.0:1788582204.738720:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020910464 00000100:00100000:2.0:1788582204.738729:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020910464 00000100:00100000:2.0:1788582204.738780:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788582204.738790:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf376680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9415e791-1a3c-4924-bcfc-d6d86718d620+3:14436:x1875464020910464:12345-0@lo:104: 00010000:00010000:2.0:1788582204.738804:0:14403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05200/0x2bc3aa892c3a7ca2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a7ca9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582204.739044:0:14403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788582204.739052:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf376680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9415e791-1a3c-4924-bcfc-d6d86718d620+3:14436:x1875464020910464:12345-0@lo:104: Request processed in 263us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582204.739059:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788582204.739108:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788582204.739115:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05200/0x2bc3aa892c3a7ca2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a7ca9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.739130:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05200 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:3.0:1788582204.739134:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05200/0x2bc3aa892c3a7ca2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a7ca9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.739143:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05200/0x2bc3aa892c3a7ca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a7ca9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788582204.739150:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05200/0x2bc3aa892c3a7ca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a7ca9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788582204.739155:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788582204.739194:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05200/0x2bc3aa892c3a7ca2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a7ca9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.739254:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788582204.739274:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05200/0x2bc3aa892c3a7ca2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a7ca9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.739281:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05200/0x2bc3aa892c3a7ca2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a7ca9 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.739295:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582204.739297:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582204.739298:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788582204.739315:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9415e791-1a3c-4924-bcfc-d6d86718d620:3306:1875464020910592:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788582204.739347:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582204.739386:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020910592 00000100:00100000:3.0:1788582204.739390:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020910592 00010000:00010000:3.0:1788582204.739408:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7ca9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7ca2 expref: 17 pid: 14415 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582204.739430:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788582204.739437:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9415e791-1a3c-4924-bcfc-d6d86718d620+17:3306:x1875464020910592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788582204.739447:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582204.739452:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7ca9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7ca2 expref: 17 pid: 14415 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.739462:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7ca9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7ca2 expref: 17 pid: 14415 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.739478:0:14407:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a7d3c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.739498:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a7d3c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788582204.739623:0:14407:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005230988s 00010000:00010000:3.0:1788582204.739629:0:14407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a7d3c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.739636:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a7d3c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.739643:0:14407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a7d3c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.739649:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a7d3c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.739655:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088600 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:3.0:1788582204.739658:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a7d3c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.739665:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a7d3c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.739674:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a7d3c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582204.739683:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582204.739722:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9415e791-1a3c-4924-bcfc-d6d86718d620+17:3306:x1875464020910592:12345-0@lo:103:ldlm_bl.0 Request processed in 285us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582204.739728:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788582204.739808:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9415e791-1a3c-4924-bcfc-d6d86718d620:3306:1875464020910592:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788582204.739957:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d88e26e00/0x2bc3aa892c3a7ca9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a7ca2 expref: 16 pid: 14415 timeout: 523 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582204.739967:0:14436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf377480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14436:1875464020910464:0@lo:104: 00010000:00010000:0.0:1788582204.739982:0:14436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a7d3c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582204.739991:0:14436:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a7d3c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582204.740008:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a7d3c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582204.740014:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0da7088600/0x2bc3aa892c3a7d3c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582204.750882:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+15:15103:x1875464020910336:12345-0@lo:253:mount.lustre.0 Request processed in 40440us (40557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582204.750899:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788582204.750990:0:15103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15103:1875464020910336:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788582204.751004:0:15103:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788582204.751008:0:15103:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788582204.751010:0:15103:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788582204.751011:0:15103:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788582204.751012:0:15103:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788582204.751013:0:15103:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788582204.751014:0:15103:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788582204.751015:0:15103:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788582204.751017:0:15103:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788582204.751018:0:15103:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788582204.751038:0:15103:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1788582204.755838:0:15103:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1788582204.756008:0:15103:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1788582204.756178:0:15103:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1788582204.756581:0:15103:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1788582204.756723:0:15103:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1788582204.756909:0:15103:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1788582204.757801:0:15103:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1788582204.795850:0:15103:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1788582204.795859:0:15103:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1788582204.795893:0:15103:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788582204.795958:0:15103:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.112@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788582204.795973:0:15103:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1788582204.796000:0:15103:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1788582204.849339:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788582205.811529:0:14417:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788582205.811537:0:14417:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d0dbbdde000 from 7 10000000:01000000:1.0:1788582205.811543:0:14417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788582205.811587:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da71fca00/0x2bc3aa892c3a7d43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582205.811599:0:14417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0da71fca00/0x2bc3aa892c3a7d43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582205.811611:0:14417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0da71fca00/0x2bc3aa892c3a7d43 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582205.811638:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020910720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788582205.811703:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582205.813597:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d9dd5ef00 going to sleep for 11 seconds 00000100:00100000:0.0:1788582205.817916:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020910720 00000100:00100000:0.0:1788582205.817944:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020910720 00000100:00100000:0.0:1788582205.818012:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788582205.818023:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+15:14417:x1875464020910720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788582205.818040:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582205.818061:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0da7089400/0x2bc3aa892c3a7d4a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a7d43 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582205.818088:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0da7089400/0x2bc3aa892c3a7d4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7d43 expref: 16 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582205.818099:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0da7089400/0x2bc3aa892c3a7d4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7d43 expref: 16 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582205.818118:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da7089400, rc 0) 00000100:00100000:0.0:1788582205.820374:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+16:14417:x1875464020910720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 2347us (8664us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582205.820387:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788582205.830735:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020910720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788582205.830767:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0da71fca00/0x2bc3aa892c3a7d43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7d4a expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582205.830780:0:14417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0da71fca00/0x2bc3aa892c3a7d43 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a7d4a expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582205.830854:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020910848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788582205.830921:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582205.830972:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d9dd5ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1788582205.831080:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020910848 00000100:00100000:2.0:1788582205.831088:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020910848 00000100:00100000:2.0:1788582205.831142:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788582205.831152:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+16:14417:x1875464020910848:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788582205.831173:0:14415:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788582205.831192:0:14415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788582205.831196:0:14415:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1788582205.831301:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+16:14417:x1875464020910848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 149us (378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582205.831309:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788582205.834032:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020910848:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788582205.834129:0:14417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788582205.834140:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da71fca00/0x2bc3aa892c3a7d43 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7d4a expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582205.834151:0:14417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0da71fca00/0x2bc3aa892c3a7d43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7d4a expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582205.873198:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582206.893325:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582207.921005:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582208.941294:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582209.987329:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788582210.031084:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788582210.031092:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788582210.031095:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788582210.031098:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788582210.031140:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788582210.031162:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9415e791-1a3c-4924-bcfc-d6d86718d620:3306:1875464020910976:0@lo:400:kworker.0 00000100:00100000:2.0:1788582210.031265:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582210.031319:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020911104:0@lo:400:kworker.0 00000100:00100000:2.0:1788582210.031366:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582210.031387:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788582210.031393:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020911232:0@lo:400:kworker.0 00000100:00100000:2.0:1788582210.031415:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582210.031446:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020910976 00000100:00100000:2.0:1788582210.031453:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020910976 00000100:00100000:2.0:1788582210.031500:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788582210.031509:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+16:3306:x1875464020910976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582210.031557:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+16:3306:x1875464020910976:12345-0@lo:400:kworker.0 Request processed in 49us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582210.031564:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788582210.031602:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020911104 00000100:00100000:2.0:1788582210.031606:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020911104 00000100:00100000:2.0:1788582210.031630:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020911232 00000100:00100000:2.0:1788582210.031633:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020911232 00000100:00100000:2.0:1788582210.031656:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788582210.031661:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaeabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020911104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582210.031700:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaeabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020911104:12345-0@lo:400:kworker.0 Request processed in 38us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582210.031706:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788582210.031717:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788582210.031723:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020911232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582210.031750:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020911232:12345-0@lo:400:kworker.0 Request processed in 27us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582210.031756:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788582210.031799:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0dbaea9880 x1875464020911232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788582226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582210.031812:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020911232:0@lo:400:kworker.0 00010000:00080000:2.0:1788582210.031823:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0dbaea8a80 x1875464020911104/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788582226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582210.031830:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020911104:0@lo:400:kworker.0 00000100:00100000:2.0:1788582210.031856:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9415e791-1a3c-4924-bcfc-d6d86718d620:3306:1875464020910976:0@lo:400:kworker.0 00000100:00080000:1.0:1788582210.031954:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788582211.020143:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788582211.424738:0:15470:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg112-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788582212.080637:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582213.111748:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788582213.487745:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788582214.125365:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788582215.150077:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788582215.150085:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788582215.150088:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788582215.150091:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788582215.150138:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875464020911488:0@lo:400:kworker.0 00000100:00100000:1.0:1788582215.150235:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582215.150290:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788582215.150296:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9415e791-1a3c-4924-bcfc-d6d86718d620:3307:1875464020911360:0@lo:400:kworker.0 00000100:00100000:1.0:1788582215.150323:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582215.150352:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020911616:0@lo:400:kworker.0 00000100:00100000:1.0:1788582215.150376:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582215.150425:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020911488 00000100:00100000:1.0:1788582215.150434:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020911488 00000100:00100000:1.0:1788582215.150475:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020911616 00000100:00100000:1.0:1788582215.150478:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020911616 00000100:00100000:1.0:1788582215.150504:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788582215.150511:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875464020911488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582215.150578:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875464020911488:12345-0@lo:400:kworker.0 Request processed in 66us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582215.150585:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788582215.150602:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788582215.150608:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020911616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582215.150639:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020911616:12345-0@lo:400:kworker.0 Request processed in 32us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582215.150645:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788582215.150662:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020911360 00000100:00100000:1.0:1788582215.150667:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020911360 00000100:00100000:1.0:1788582215.150691:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788582215.150697:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+16:3307:x1875464020911360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582215.150725:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+16:3307:x1875464020911360:12345-0@lo:400:kworker.0 Request processed in 28us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582215.150730:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788582215.150758:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788582215.150789:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0dbbdc2300 x1875464020911616/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788582231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582215.150804:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020911616:0@lo:400:kworker.0 00000100:00100000:1.0:1788582215.150835:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9415e791-1a3c-4924-bcfc-d6d86718d620:3307:1875464020911360:0@lo:400:kworker.0 00010000:00080000:1.0:1788582215.150857:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0dbbdc3100 x1875464020911488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788582231 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788582215.150866:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875464020911488:0@lo:400:kworker.0 00010000:00010000:3.0:1788582215.151022:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582215.981294:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788582200/real 1788582200] req@ffff8d0dbbdc2a00 x1875464020907008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788582215 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582215.981339:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d0dbbdc2a00 x1875464020907008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788582215 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582215.981356:0:3305:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788582200/real 1788582200] req@ffff8d0dbbdc1500 x1875464020907136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788582215 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582215.981368:0:3305:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d0dbbdc1500 x1875464020907136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788582215 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788582215.981388:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0dbbd46000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788582215.981419:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788582215.981423:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020907008:0@lo:8:kworker.0 00000100:00080000:2.0:1788582215.981429:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0da7180000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788582215.981434:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788582215.981437:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020907136:0@lo:8:kworker.0 00000100:00080000:1.0:1788582215.982540:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788582215.982549:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788582215.982552:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d0dbbd46000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788582215.982559:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 419 00000100:00080000:1.0:1788582215.982565:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788582215.982573:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d0dbbd46000 using connection 192.168.201.112@tcp/0@lo 00000100:00100000:1.0:1788582215.982606:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0dbbdc3100 x1875464020911744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788582215.982636:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788582215.982640:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788582215.982641:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d0da7180000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788582215.982645:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 419 00000100:00080000:1.0:1788582215.982648:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788582215.982651:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d0da7180000 using connection 192.168.201.112@tcp/0@lo 00000100:00100000:1.0:1788582215.982665:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0dbbdc2d80 x1875464020911872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788582215.982867:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020911744:0@lo:8:kworker.0 00000100:00100000:2.0:1788582215.982945:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582215.983048:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020911872:0@lo:8:kworker.0 00000100:00100000:2.0:1788582215.983076:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582215.985095:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020911744 00000100:00100000:1.0:1788582215.985109:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020911744 00000100:00100000:1.0:1788582215.985177:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020911872 00000100:00100000:1.0:1788582215.985181:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020911872 00000100:00100000:2.0:1788582215.985250:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788582215.985259:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1875464020911744:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788582215.985306:0:15107:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 434 last 0 00000020:00000080:2.0:1788582215.985449:0:15107:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bc3aa892c3a7d51 00002000:00100000:2.0:1788582215.985466:0:15107:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d0d9d888000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788582215.985471:0:15107:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788582215.985474:0:15107:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788582215.985901:0:15107:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788582215.985947:0:15107:0:(import.c:65:import_set_state_nolock()) ffff8d0d9d88f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788582215.986452:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1875464020911744:12345-0@lo:8:kworker.0 Request processed in 760us (3074us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582215.986461:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788582215.986484:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788582215.986490:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1875464020911872:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788582215.986505:0:15107:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788582215.986615:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3305:x1875464020911872:12345-0@lo:8:kworker.0 Request processed in 49us (3463us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788582215.986623:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788582215.986666:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0dbbdc3100 x1875464020911744/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788582235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582215.986678:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788582215.986686:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788582215.986694:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788582215.986699:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788582215.986701:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0dbbd46000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788582215.986727:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788582215.986733:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020911744:0@lo:8:kworker.0 00000100:00080000:2.0:1788582215.986746:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0da7180000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788582215.986750:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788582215.986752:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020911872:0@lo:8:kworker.0 00000004:00080000:2.0:1788582215.986811:0:14443:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1788582215.986831:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaeab100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14443:1875464020912128:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788582215.986922:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582215.986964:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dab9c2600 going to sleep for 11 seconds 00000100:00100000:2.0:1788582215.986979:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020912000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788582215.987007:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582215.987146:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020912128 00000100:00100000:1.0:1788582215.987153:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020912128 00000100:00100000:1.0:1788582215.987197:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788582215.987220:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaeaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14443:x1875464020912128:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788582215.987613:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020912000 00000100:00100000:2.0:1788582215.987618:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020912000 00000100:00100000:2.0:1788582215.987648:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788582215.987655:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaeab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875464020912000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788582215.987679:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788582215.987718:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaeab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875464020912000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582215.987725:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788582215.987755:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0dbaea9880 x1875464020912000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582231 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582215.987772:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020912000:0@lo:13:osp-pre-0-0.0 00000004:00080000:0.0:1788582215.990540:0:14442:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788582215.990803:0:14442:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 434984599662ns, next at 0ns, rc = 0 00000100:00080000:1.0:1788582215.994265:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1788582216.013982:0:15104:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788582216.013997:0:15104:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1788582216.014004:0:15104:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:1.0:1788582216.041884:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788582216.041901:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c48b440/0x2bc3aa892c3a7d58 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.041918:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1788582216.041923:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582216.041939:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c48b440/0x2bc3aa892c3a7d58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.041957:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c48b440/0x2bc3aa892c3a7d58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.041968:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c48b440/0x2bc3aa892c3a7d58 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.041977:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c48b440/0x2bc3aa892c3a7d58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.042263:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788582216.042346:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788582216.042353:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c48b440/0x2bc3aa892c3a7d58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.042361:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fce00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:0.0:1788582216.042365:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c48b440/0x2bc3aa892c3a7d58 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.042386:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c48b440/0x2bc3aa892c3a7d58 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.042404:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c48b440/0x2bc3aa892c3a7d58 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.042409:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c48b440/0x2bc3aa892c3a7d58 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.042426:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582216.042428:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582216.042430:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788582216.046561:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788582216.046575:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7d5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.046598:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1788582216.046603:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582216.047366:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7d5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.047384:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7d5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.047395:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7d5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.047403:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7d5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.047425:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788582216.047440:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788582216.047446:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7d5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.047454:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fde00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582216.047459:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7d5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.047469:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7d5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.047500:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7d5f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.047508:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7d5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.047528:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582216.047530:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582216.047532:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788582216.048687:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788582216.049141:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788582216.049148:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d29a570/0x2bc3aa892c3a7d66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.049159:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1788582216.049162:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582216.049165:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d29a570/0x2bc3aa892c3a7d66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.049173:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d29a570/0x2bc3aa892c3a7d66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.049179:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d29a570/0x2bc3aa892c3a7d66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.049184:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d29a570/0x2bc3aa892c3a7d66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.049232:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788582216.049278:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788582216.049285:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d29a570/0x2bc3aa892c3a7d66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.049292:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd200 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:0.0:1788582216.049296:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d29a570/0x2bc3aa892c3a7d66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.049305:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d29a570/0x2bc3aa892c3a7d66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.049431:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d29a570/0x2bc3aa892c3a7d66 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.049450:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d29a570/0x2bc3aa892c3a7d66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.049466:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582216.049468:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582216.049469:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788582216.052228:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788582216.052241:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2a78ca3/0x2bc3aa892c3a7d6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.052271:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1788582216.052401:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582216.052408:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2a78ca3/0x2bc3aa892c3a7d6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.052423:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2a78ca3/0x2bc3aa892c3a7d6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.052433:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2a78ca3/0x2bc3aa892c3a7d6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.052438:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2a78ca3/0x2bc3aa892c3a7d6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.052457:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788582216.052546:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788582216.052553:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2a78ca3/0x2bc3aa892c3a7d6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.052561:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fdc00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:3.0:1788582216.052565:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2a78ca3/0x2bc3aa892c3a7d6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.052574:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2a78ca3/0x2bc3aa892c3a7d6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.052603:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2a78ca3/0x2bc3aa892c3a7d6d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.052610:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2a78ca3/0x2bc3aa892c3a7d6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.052629:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582216.052631:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582216.052633:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788582216.053488:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788582216.053496:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003699727a/0x2bc3aa892c3a7d74 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.053507:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1788582216.053517:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582216.053522:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003699727a/0x2bc3aa892c3a7d74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.053535:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003699727a/0x2bc3aa892c3a7d74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.054249:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003699727a/0x2bc3aa892c3a7d74 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.054259:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003699727a/0x2bc3aa892c3a7d74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.054403:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788582216.054899:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788582216.054907:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003699727a/0x2bc3aa892c3a7d74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.054916:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd000 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:0.0:1788582216.054921:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003699727a/0x2bc3aa892c3a7d74 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.054941:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003699727a/0x2bc3aa892c3a7d74 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.054960:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003699727a/0x2bc3aa892c3a7d74 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.054968:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003699727a/0x2bc3aa892c3a7d74 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.054991:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582216.054993:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582216.054995:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788582216.056902:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788582216.056913:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7d7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.056938:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1788582216.056943:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582216.056949:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7d7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.056962:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7d7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.056972:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7d7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.056985:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7d7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.057445:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582216.057453:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7d7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.057462:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fc600 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582216.057466:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7d7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.057542:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7d7b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.057565:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7d7b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.057580:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.057582:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.057584:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582216.058357:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788582216.058367:0:15104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7d7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788582216.062684:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788582216.062697:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afedd3cd/0x2bc3aa892c3a7d82 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.062712:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1788582216.062717:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582216.062722:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afedd3cd/0x2bc3aa892c3a7d82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.062735:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afedd3cd/0x2bc3aa892c3a7d82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.062744:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afedd3cd/0x2bc3aa892c3a7d82 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.062751:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afedd3cd/0x2bc3aa892c3a7d82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.062773:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788582216.062787:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788582216.062792:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afedd3cd/0x2bc3aa892c3a7d82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.062799:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089600 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:0.0:1788582216.062804:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afedd3cd/0x2bc3aa892c3a7d82 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.062825:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afedd3cd/0x2bc3aa892c3a7d82 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.062853:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afedd3cd/0x2bc3aa892c3a7d82 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.062860:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afedd3cd/0x2bc3aa892c3a7d82 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.062876:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582216.062878:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582216.062880:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788582216.065686:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788582216.065698:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091976dd1/0x2bc3aa892c3a7d89 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.065713:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1788582216.065719:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582216.065724:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091976dd1/0x2bc3aa892c3a7d89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.065737:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091976dd1/0x2bc3aa892c3a7d89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.065748:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000091976dd1/0x2bc3aa892c3a7d89 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.065763:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000091976dd1/0x2bc3aa892c3a7d89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.065789:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788582216.065964:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788582216.065971:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000091976dd1/0x2bc3aa892c3a7d89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.065991:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089a00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:3.0:1788582216.065995:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000091976dd1/0x2bc3aa892c3a7d89 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.066004:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000091976dd1/0x2bc3aa892c3a7d89 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.066021:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000091976dd1/0x2bc3aa892c3a7d89 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.066028:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091976dd1/0x2bc3aa892c3a7d89 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.066043:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582216.066045:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582216.066047:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788582216.066232:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788582216.066238:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7d90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.066246:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1788582216.066250:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582216.066253:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7d90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.066262:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7d90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.066270:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7d90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.066277:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7d90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.066294:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788582216.066684:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788582216.066689:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a939a8e7/0x2bc3aa892c3a7d97 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.066702:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1788582216.066705:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582216.066709:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a939a8e7/0x2bc3aa892c3a7d97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.066718:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a939a8e7/0x2bc3aa892c3a7d97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.066726:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a939a8e7/0x2bc3aa892c3a7d97 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.066732:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a939a8e7/0x2bc3aa892c3a7d97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.066755:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788582216.066973:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788582216.066980:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7d90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.066987:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088000 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582216.066991:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7d90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.066998:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7d90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.067010:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7d90 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.067017:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d7cd912/0x2bc3aa892c3a7d90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.067033:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582216.067036:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a939a8e7/0x2bc3aa892c3a7d97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.067043:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089e00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582216.067050:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a939a8e7/0x2bc3aa892c3a7d97 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.067058:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a939a8e7/0x2bc3aa892c3a7d97 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.067069:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a939a8e7/0x2bc3aa892c3a7d97 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.067076:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a939a8e7/0x2bc3aa892c3a7d97 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.067089:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.067090:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.067092:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582216.067128:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788582216.067154:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788582216.067160:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3b912c/0x2bc3aa892c3a7d9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.067168:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1788582216.067171:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582216.067175:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000b3b912c/0x2bc3aa892c3a7d9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.067183:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000b3b912c/0x2bc3aa892c3a7d9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.067215:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000b3b912c/0x2bc3aa892c3a7d9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.067224:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000b3b912c/0x2bc3aa892c3a7d9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.067238:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788582216.067449:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582216.067454:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000b3b912c/0x2bc3aa892c3a7d9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.067461:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089800 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582216.067464:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3b912c/0x2bc3aa892c3a7d9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.067471:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000b3b912c/0x2bc3aa892c3a7d9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.067551:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000b3b912c/0x2bc3aa892c3a7d9e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.067564:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000b3b912c/0x2bc3aa892c3a7d9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.067577:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.067579:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.067581:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788582216.067604:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788582216.067610:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ad24735/0x2bc3aa892c3a7da5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.067619:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1788582216.067622:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582216.067625:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ad24735/0x2bc3aa892c3a7da5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.067634:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ad24735/0x2bc3aa892c3a7da5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.067642:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ad24735/0x2bc3aa892c3a7da5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.067649:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ad24735/0x2bc3aa892c3a7da5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.067680:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788582216.067788:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788582216.067794:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ad24735/0x2bc3aa892c3a7da5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.067802:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089000 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582216.067806:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ad24735/0x2bc3aa892c3a7da5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.067813:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ad24735/0x2bc3aa892c3a7da5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.067825:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ad24735/0x2bc3aa892c3a7da5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.067832:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ad24735/0x2bc3aa892c3a7da5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.067856:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582216.067858:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582216.067860:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788582216.077729:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788582216.077745:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fdeb881/0x2bc3aa892c3a7dac lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.077763:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1788582216.077768:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582216.077775:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001fdeb881/0x2bc3aa892c3a7dac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.077789:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001fdeb881/0x2bc3aa892c3a7dac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.077799:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001fdeb881/0x2bc3aa892c3a7dac lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.077807:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001fdeb881/0x2bc3aa892c3a7dac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.077831:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788582216.078340:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582216.078348:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001fdeb881/0x2bc3aa892c3a7dac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.078357:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088a00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582216.078361:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001fdeb881/0x2bc3aa892c3a7dac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.078371:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001fdeb881/0x2bc3aa892c3a7dac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.078388:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001fdeb881/0x2bc3aa892c3a7dac lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.078396:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001fdeb881/0x2bc3aa892c3a7dac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.078413:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.078416:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.078418:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788582216.079413:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788582216.079424:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000630b5196/0x2bc3aa892c3a7db3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.079437:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1788582216.079448:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582216.079454:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000630b5196/0x2bc3aa892c3a7db3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.079466:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000630b5196/0x2bc3aa892c3a7db3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.079475:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000630b5196/0x2bc3aa892c3a7db3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.079483:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000630b5196/0x2bc3aa892c3a7db3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.079507:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788582216.079556:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788582216.079563:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000630b5196/0x2bc3aa892c3a7db3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.079570:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088600 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582216.079574:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000630b5196/0x2bc3aa892c3a7db3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.079582:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000630b5196/0x2bc3aa892c3a7db3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.079596:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000630b5196/0x2bc3aa892c3a7db3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.079603:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000630b5196/0x2bc3aa892c3a7db3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.079622:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582216.079624:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582216.079626:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788582216.081797:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788582216.081810:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7dba lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.081823:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1788582216.081828:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582216.081833:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7dba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.081844:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7dba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.081853:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7dba lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.081866:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7dba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.081889:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788582216.082449:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582216.082457:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7dba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.082467:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088400 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582216.082472:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7dba lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.082554:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7dba lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.082574:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7dba lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.082582:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ea74fc9b/0x2bc3aa892c3a7dba lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.082602:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.082604:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.082606:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788582216.085819:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788582216.086720:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7dc1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.086742:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1788582216.086747:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582216.086754:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7dc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.086770:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7dc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.086782:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7dc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.086791:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7dc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.086817:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788582216.087727:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788582216.087736:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e446eb0f/0x2bc3aa892c3a7dc8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.087751:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1788582216.087755:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582216.087760:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e446eb0f/0x2bc3aa892c3a7dc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.087771:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e446eb0f/0x2bc3aa892c3a7dc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.087780:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e446eb0f/0x2bc3aa892c3a7dc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.087787:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e446eb0f/0x2bc3aa892c3a7dc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.087803:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788582216.088693:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788582216.088703:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7dc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.088712:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7089c00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582216.088717:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7dc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.088739:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7dc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.088760:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7dc1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.088768:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7ba9c90/0x2bc3aa892c3a7dc1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.088788:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582216.088792:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e446eb0f/0x2bc3aa892c3a7dc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.088798:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2e00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582216.088800:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e446eb0f/0x2bc3aa892c3a7dc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.088808:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e446eb0f/0x2bc3aa892c3a7dc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.088817:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e446eb0f/0x2bc3aa892c3a7dc8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.088824:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e446eb0f/0x2bc3aa892c3a7dc8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.088849:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.088851:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.088853:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.088860:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788582216.089029:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788582216.089036:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7d51c25/0x2bc3aa892c3a7dcf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.089045:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1788582216.089049:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582216.089053:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b7d51c25/0x2bc3aa892c3a7dcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.089064:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b7d51c25/0x2bc3aa892c3a7dcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.089083:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b7d51c25/0x2bc3aa892c3a7dcf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.089090:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b7d51c25/0x2bc3aa892c3a7dcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.089113:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788582216.089801:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788582216.089807:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb36b184/0x2bc3aa892c3a7dd6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.089816:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1788582216.089819:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582216.089822:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bb36b184/0x2bc3aa892c3a7dd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.089831:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bb36b184/0x2bc3aa892c3a7dd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.089839:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bb36b184/0x2bc3aa892c3a7dd6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.089846:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bb36b184/0x2bc3aa892c3a7dd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.089876:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788582216.089885:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788582216.089890:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b7d51c25/0x2bc3aa892c3a7dcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.089898:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e3400 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582216.089902:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7d51c25/0x2bc3aa892c3a7dcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.089910:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b7d51c25/0x2bc3aa892c3a7dcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.089921:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b7d51c25/0x2bc3aa892c3a7dcf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.089941:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b7d51c25/0x2bc3aa892c3a7dcf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.089954:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582216.089957:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bb36b184/0x2bc3aa892c3a7dd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.089963:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e3200 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582216.089971:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb36b184/0x2bc3aa892c3a7dd6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.089979:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bb36b184/0x2bc3aa892c3a7dd6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.089990:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bb36b184/0x2bc3aa892c3a7dd6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.089997:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bb36b184/0x2bc3aa892c3a7dd6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.090009:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.090010:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.090012:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788582216.091137:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788582216.091147:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0a4f3ba/0x2bc3aa892c3a7ddd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.091160:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1788582216.091164:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582216.091169:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0a4f3ba/0x2bc3aa892c3a7ddd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.091181:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0a4f3ba/0x2bc3aa892c3a7ddd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.091189:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0a4f3ba/0x2bc3aa892c3a7ddd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.091195:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0a4f3ba/0x2bc3aa892c3a7ddd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.091242:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788582216.091253:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582216.091258:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0a4f3ba/0x2bc3aa892c3a7ddd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.091266:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2800 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582216.091270:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0a4f3ba/0x2bc3aa892c3a7ddd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.091279:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0a4f3ba/0x2bc3aa892c3a7ddd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.091292:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0a4f3ba/0x2bc3aa892c3a7ddd lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.091305:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0a4f3ba/0x2bc3aa892c3a7ddd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.091322:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.091324:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.091326:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788582216.092172:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788582216.092180:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000453a00be/0x2bc3aa892c3a7de4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.092191:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=435s v=(0 0) 00010000:00010000:3.0:1788582216.092211:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582216.092214:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582216.092219:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000453a00be/0x2bc3aa892c3a7de4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.092230:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000453a00be/0x2bc3aa892c3a7de4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.092238:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000453a00be/0x2bc3aa892c3a7de4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.092245:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000453a00be/0x2bc3aa892c3a7de4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.092434:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788582216.092714:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788582216.092720:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000453a00be/0x2bc3aa892c3a7de4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.092728:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2c00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:3.0:1788582216.092732:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000453a00be/0x2bc3aa892c3a7de4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.092751:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000453a00be/0x2bc3aa892c3a7de4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.092764:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000453a00be/0x2bc3aa892c3a7de4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.092770:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000453a00be/0x2bc3aa892c3a7de4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.092786:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582216.092788:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582216.092790:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788582216.093109:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788582216.093115:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d449b96e/0x2bc3aa892c3a7deb lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.093124:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1788582216.093128:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582216.093132:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d449b96e/0x2bc3aa892c3a7deb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.093142:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d449b96e/0x2bc3aa892c3a7deb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.093150:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d449b96e/0x2bc3aa892c3a7deb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.093165:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d449b96e/0x2bc3aa892c3a7deb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.093177:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788582216.093244:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788582216.093250:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d449b96e/0x2bc3aa892c3a7deb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.093257:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e3800 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:3.0:1788582216.093271:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d449b96e/0x2bc3aa892c3a7deb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.093280:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d449b96e/0x2bc3aa892c3a7deb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.093293:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d449b96e/0x2bc3aa892c3a7deb lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.093310:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d449b96e/0x2bc3aa892c3a7deb lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.093435:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582216.093437:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582216.093439:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788582216.095479:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788582216.095492:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2904243/0x2bc3aa892c3a7df2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.095507:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1788582216.095512:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582216.095518:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2904243/0x2bc3aa892c3a7df2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.095531:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2904243/0x2bc3aa892c3a7df2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.095552:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2904243/0x2bc3aa892c3a7df2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.095560:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2904243/0x2bc3aa892c3a7df2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.095584:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788582216.095644:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788582216.095651:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2904243/0x2bc3aa892c3a7df2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.095659:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2200 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:3.0:1788582216.095664:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2904243/0x2bc3aa892c3a7df2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.095673:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2904243/0x2bc3aa892c3a7df2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.095688:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2904243/0x2bc3aa892c3a7df2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.095695:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2904243/0x2bc3aa892c3a7df2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582216.095721:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582216.095723:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582216.095725:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788582216.098643:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788582216.098658:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bf7acd0/0x2bc3aa892c3a7df9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.098681:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1788582216.098685:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582216.098691:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004bf7acd0/0x2bc3aa892c3a7df9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.098705:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004bf7acd0/0x2bc3aa892c3a7df9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.098715:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004bf7acd0/0x2bc3aa892c3a7df9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.098722:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004bf7acd0/0x2bc3aa892c3a7df9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.099399:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788582216.100590:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582216.100600:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004bf7acd0/0x2bc3aa892c3a7df9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.100613:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2000 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582216.100618:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004bf7acd0/0x2bc3aa892c3a7df9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.100630:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004bf7acd0/0x2bc3aa892c3a7df9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.100649:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004bf7acd0/0x2bc3aa892c3a7df9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.100656:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004bf7acd0/0x2bc3aa892c3a7df9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.100677:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.100678:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.100680:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788582216.101145:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788582216.101153:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000217b000/0x2bc3aa892c3a7e00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.101164:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=435s v=(0 0) 00010000:00010000:0.0:1788582216.101169:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582216.101174:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000217b000/0x2bc3aa892c3a7e00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.101186:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000217b000/0x2bc3aa892c3a7e00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.101521:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000217b000/0x2bc3aa892c3a7e00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.101530:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000217b000/0x2bc3aa892c3a7e00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582216.101633:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788582216.101794:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582216.101800:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000217b000/0x2bc3aa892c3a7e00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.101809:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2400 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582216.101814:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000217b000/0x2bc3aa892c3a7e00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.101822:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000217b000/0x2bc3aa892c3a7e00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.101835:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000217b000/0x2bc3aa892c3a7e00 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.101843:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000217b000/0x2bc3aa892c3a7e00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.101857:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.101859:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.101861:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788582216.103496:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788582216.103507:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7e07 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.103535:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1788582216.103539:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582216.103544:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7e07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.103558:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7e07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.103567:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7e07 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.103574:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7e07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.103593:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788582216.104167:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788582216.104173:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c48b440/0x2bc3aa892c3a7e0e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.104182:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1788582216.104185:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582216.104190:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c48b440/0x2bc3aa892c3a7e0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.104233:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c48b440/0x2bc3aa892c3a7e0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.104252:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c48b440/0x2bc3aa892c3a7e0e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.104260:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c48b440/0x2bc3aa892c3a7e0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.104272:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788582216.106287:0:15104:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788582216.106298:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7e15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.106666:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788582216.106674:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7e07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.106684:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fde00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582216.106689:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7e07 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.106775:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7e07 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.106794:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7e07 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.106802:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7e07 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.106817:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582216.106821:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c48b440/0x2bc3aa892c3a7e0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.106827:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fce00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582216.106830:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c48b440/0x2bc3aa892c3a7e0e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.106838:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c48b440/0x2bc3aa892c3a7e0e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.106846:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c48b440/0x2bc3aa892c3a7e0e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.106852:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c48b440/0x2bc3aa892c3a7e0e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.106874:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.106877:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.106879:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.106887:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582216.107422:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=435s v=(0 0) 00010000:00010000:1.0:1788582216.107429:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582216.107437:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7e15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.107451:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7e15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.107461:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7e15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.107469:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7e15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582216.107824:0:15104:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:1.0:1788582216.108121:0:15104:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:1.0:1788582216.108246:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaeaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14443:x1875464020912128:12345-0@lo:5:osp-pre-0-0.0 Request processed in 121024us (121319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582216.108257:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788582216.108294:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaeab100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14443:1875464020912128:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788582216.108310:0:14443:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1788582216.108355:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf377480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14443:1875464020912256:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788582216.108390:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582216.108430:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da791de40 going to sleep for 11 seconds 00010000:00010000:2.0:1788582216.113946:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582216.113963:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7e15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.113978:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fc600 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582216.113983:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7e15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.113995:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7e15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.114090:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7e15 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.114099:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7e15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582216.114121:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.114123:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582216.114125:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582216.114148:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020912256 00000100:00100000:2.0:1788582216.114160:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020912256 00000100:00100000:2.0:1788582216.114660:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788582216.114671:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14443:x1875464020912256:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1788582216.114725:0:15107:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1788582216.121882:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf376300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14443:x1875464020912256:12345-0@lo:5:osp-pre-0-0.0 Request processed in 7204us (13482us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788582216.121896:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788582216.122649:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf377480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14443:1875464020912256:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788582216.122667:0:14443:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:0.0:1788582216.178804:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582217.198479:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582218.221718:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788582218.844635:0:15819:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788582218.844640:0:15819:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1788582218.844841:0:15819:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d0d9d88a000 00000020:01000004:2.0:1788582218.844857:0:15819:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1788582218.844870:0:15819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1788582218.844893:0:15819:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d0dae4419b8) 00000020:00000080:2.0:1788582218.844911:0:15819:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788582218.864182:0:15819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788582218.864620:0:15819:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788582218.866551:0:15819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788582218.866864:0:15819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788582218.867088:0:15819:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788582218.867609:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 463: rc = 0 00100000:10000000:2.0:1788582218.867878:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 463: rc = 0 00100000:10000000:2.0:1788582218.868016:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 463: rc = 0 00100000:10000000:2.0:1788582218.869025:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 647: rc = 0 00100000:10000000:3.0:1788582218.870388:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 647: rc = 0 00100000:10000000:3.0:1788582218.871070:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 647: rc = 0 00100000:10000000:3.0:1788582218.871515:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 647: rc = 0 00100000:10000000:3.0:1788582218.871891:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 647: rc = 0 00100000:10000000:3.0:1788582218.872104:0:15819:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 647: rc = 0 00000020:00000080:3.0:1788582218.874426:0:15819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788582218.874443:0:15819:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788582218.874457:0:15819:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2bc3aa892c3a7e23 00000020:01000004:3.0:1788582218.874466:0:15819:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788582218.874487:0:15819:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.201.112@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788582218.874490:0:15819:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788582218.874496:0:15819:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788582218.874516:0:15819:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788582218.874521:0:15819:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.112@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788582218.891326:0:15819:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.112@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788582218.891363:0:15819:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.112@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788582218.891367:0:15819:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788582218.891369:0:15819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788582218.891370:0:15819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788582218.891371:0:15819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788582218.891372:0:15819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788582218.891373:0:15819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788582218.891375:0:15819:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788582218.891376:0:15819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788582218.891378:0:15819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788582218.891381:0:15819:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788582218.891384:0:15819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788582218.891385:0:15819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788582218.891386:0:15819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788582218.891387:0:15819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788582218.891388:0:15819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788582218.891389:0:15819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788582218.891389:0:15819:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788582218.891394:0:15819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788582218.891395:0:15819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788582218.891422:0:15819:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788582218.891444:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020912384:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788582218.891533:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582218.891592:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0c837a53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788582218.891750:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020912384 00000100:00100000:2.0:1788582218.891758:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020912384 00000100:00100000:2.0:1788582218.891808:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788582218.891817:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+16:15819:x1875464020912384:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788582218.891852:0:14415:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788582218.891859:0:14415:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:2.0:1788582218.891863:0:14415:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1788582218.907152:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+16:15819:x1875464020912384:12345-0@lo:253:mount.lustre.0 Request processed in 15325us (15621us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582218.907170:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788582218.907544:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020912384:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788582218.907562:0:15819:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788582218.907566:0:15819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788582218.907568:0:15819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788582218.907570:0:15819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788582218.907571:0:15819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788582218.907572:0:15819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788582218.907574:0:15819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788582218.907575:0:15819:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788582218.907578:0:15819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788582218.907579:0:15819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788582218.907824:0:15819:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d0d9d88a000 from lustre-OST0001 10000000:01000000:2.0:1788582218.907853:0:15819:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1788582218.907856:0:15819:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788582218.907866:0:15819:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d0dbf4e0000 local copy 00010000:00010000:2.0:1788582218.907889:0:15819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da71fcc00/0x2bc3aa892c3a7bc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7bd0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582218.908180:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020912512:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788582218.908478:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582218.908562:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da3261b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788582218.908608:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020912512 00000100:00100000:1.0:1788582218.908616:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020912512 00000100:00100000:1.0:1788582218.911125:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788582218.911152:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+16:15819:x1875464020912512:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788582218.912086:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+16:15819:x1875464020912512:12345-0@lo:501:mount.lustre.0 Request processed in 943us (3604us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788582218.912097:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788582218.916941:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020912512:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788582218.916977:0:15819:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788582218.917901:0:15819:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788582218.917914:0:15819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da71fcc00/0x2bc3aa892c3a7bc9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7bd0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582218.917927:0:15819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0da71fcc00/0x2bc3aa892c3a7bc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7bd0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788582218.917966:0:15819:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d0d9d88a000 10000000:01000000:0.0:1788582218.917971:0:15819:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788582218.917977:0:15819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788582218.917980:0:15819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788582218.917984:0:15819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1788582218.917988:0:15819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1788582218.918026:0:15819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d9d8e3e00/0x2bc3aa892c3a7e2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582218.918034:0:15819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d9d8e3e00/0x2bc3aa892c3a7e2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582218.918045:0:15819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d9d8e3e00/0x2bc3aa892c3a7e2a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582218.918069:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020912640:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788582218.918139:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582218.918554:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da791d780 going to sleep for 11 seconds 00000100:00100000:1.0:1788582218.919614:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020912640 00000100:00100000:1.0:1788582218.919632:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020912640 00000100:00100000:1.0:1788582218.919696:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788582218.919707:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+16:15819:x1875464020912640:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788582218.919725:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582218.919758:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0da71fd400/0x2bc3aa892c3a7e31 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a7e2a expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582218.919788:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0da71fd400/0x2bc3aa892c3a7e31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7e2a expref: 17 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582218.919800:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0da71fd400/0x2bc3aa892c3a7e31 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7e2a expref: 17 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582218.919831:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0da71fd400, rc 0) 00000100:00100000:1.0:1788582218.919907:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+17:15819:x1875464020912640:12345-0@lo:101:mount.lustre.0 Request processed in 202us (1767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582218.919915:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788582218.920914:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020912640:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788582218.920937:0:15819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d9d8e3e00/0x2bc3aa892c3a7e2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7e31 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582218.920948:0:15819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d9d8e3e00/0x2bc3aa892c3a7e2a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a7e31 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788582218.932116:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1788582218.935058:0:15819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788582218.935706:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1788582218.936474:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1788582218.936538:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1788582218.936591:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1788582218.936622:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1788582218.936844:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1788582218.936944:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1788582218.936954:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1788582218.937066:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020912768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788582218.937143:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582218.937483:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da791df00 going to sleep for 11 seconds 00000100:00100000:1.0:1788582218.937564:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020912768 00000100:00100000:1.0:1788582218.937572:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020912768 00000100:00100000:1.0:1788582218.937649:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788582218.937672:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+17:15819:x1875464020912768:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788582218.938070:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+17:15819:x1875464020912768:12345-0@lo:501:mount.lustre.0 Request processed in 398us (926us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582218.938079:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788582218.938161:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020912768:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788582218.938198:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020912896:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788582218.938282:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582218.938962:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da791df00 going to sleep for 11 seconds 00000100:00100000:3.0:1788582218.939052:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020912896 00000100:00100000:3.0:1788582218.939060:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020912896 00000100:00100000:3.0:1788582218.939102:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788582218.939111:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+17:15819:x1875464020912896:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788582218.939972:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020912896:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788582218.941384:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+17:15819:x1875464020912896:12345-0@lo:503:mount.lustre.0 Request processed in 2266us (3094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582218.941395:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000040:00080000:0.0:1788582218.941755:0:15819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788582218.941839:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020913024:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788582218.941916:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582218.941956:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dc205c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788582218.942070:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020913024 00000100:00100000:3.0:1788582218.942077:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020913024 00000100:00100000:3.0:1788582218.942108:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788582218.942116:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dc2070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+17:15819:x1875464020913024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788582218.942386:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dc2070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+17:15819:x1875464020913024:12345-0@lo:502:mount.lustre.0 Request processed in 271us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582218.942394:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788582218.942904:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020913024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788582218.943189:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788582218.943388:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788582218.943427:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788582218.943475:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788582218.943511:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788582218.943542:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788582218.943588:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788582218.943634:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788582218.943849:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1788582218.943904:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020913152:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788582218.943966:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582218.944069:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da791df00 going to sleep for 11 seconds 00000100:00100000:2.0:1788582218.944611:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020913152 00000100:00100000:2.0:1788582218.944619:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020913152 00000100:00100000:3.0:1788582218.945014:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788582218.945027:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dc2071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+17:15819:x1875464020913152:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788582218.945461:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dc2071050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+17:15819:x1875464020913152:12345-0@lo:502:mount.lustre.0 Request processed in 435us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582218.945469:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788582218.945576:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020913152:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788582218.945693:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1788582218.945709:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:3.0:1788582218.948515:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788582218.948527:0:15821:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1788582218.948535:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788582218.948537:0:15821:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788582218.948544:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788582218.948562:0:15821:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d0d97e9b370) 00000020:00000080:3.0:1788582218.948589:0:15821:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788582218.948596:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788582218.948730:0:15821:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d0d9d88a000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788582218.948806:0:15821:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788582218.948816:0:15821:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x2bc3aa892c3a7e3f 00010000:00010000:2.0:1788582218.955025:0:15821:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1788582218.955915:0:15821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:2.0:1788582218.960593:0:15821:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788582218.963958:0:15821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788582218.963969:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788582218.963976:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788582218.963978:0:15821:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788582218.963981:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788582218.963985:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788582218.963986:0:15821:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788582218.963989:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788582218.963991:0:15821:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788582218.963994:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788582218.963996:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788582218.964004:0:15821:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788582218.964007:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788582218.964010:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788582218.964011:0:15821:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788582218.964014:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788582218.964082:0:15821:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788582218.964086:0:15821:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788582218.964087:0:15821:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788582218.964090:0:15821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788582218.964961:0:15819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788582218.964995:0:15819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788582218.965048:0:15819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d9d8e3e00/0x2bc3aa892c3a7e2a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7e31 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582218.965061:0:15819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d9d8e3e00/0x2bc3aa892c3a7e2a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7e31 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788582218.965070:0:15819:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0d9d88a000 from 1 10000000:01000000:3.0:1788582218.965073:0:15819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788582218.965112:0:15819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27a00/0x2bc3aa892c3a7e46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582218.965120:0:15819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27a00/0x2bc3aa892c3a7e46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582218.965146:0:15819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27a00/0x2bc3aa892c3a7e46 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582218.965171:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020913280:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788582218.965340:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582218.965383:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dab9c2780 going to sleep for 11 seconds 00000100:00100000:2.0:1788582218.965460:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020913280 00000100:00100000:2.0:1788582218.965468:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020913280 00000100:00100000:2.0:1788582218.965518:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788582218.965527:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dc2072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+17:15819:x1875464020913280:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788582218.965540:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582218.965553:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0dbbe04600/0x2bc3aa892c3a7e4d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a7e46 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582218.965578:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0dbbe04600/0x2bc3aa892c3a7e4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7e46 expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582218.965588:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0dbbe04600/0x2bc3aa892c3a7e4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7e46 expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582218.965597:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04600, rc 0) 00000100:00100000:2.0:1788582218.965635:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dc2072850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+18:15819:x1875464020913280:12345-0@lo:101:mount.lustre.0 Request processed in 109us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582218.965642:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788582218.965728:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020913280:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788582218.965812:0:15819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27a00/0x2bc3aa892c3a7e46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7e4d expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582218.965822:0:15819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27a00/0x2bc3aa892c3a7e46 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a7e4d expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788582218.966507:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788582218.968085:0:15819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788582218.968904:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788582218.968955:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788582218.969025:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788582218.969034:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788582218.969114:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020913408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788582218.969185:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582218.969257:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dab9c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788582218.969469:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020913408 00000100:00100000:0.0:1788582218.969475:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020913408 00000100:00100000:0.0:1788582218.969516:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788582218.969522:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c81972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+18:15819:x1875464020913408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788582218.970796:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c81972850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+18:15819:x1875464020913408:12345-0@lo:501:mount.lustre.0 Request processed in 1267us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582218.970808:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788582218.970827:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020913408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788582218.970872:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020913536:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788582218.970926:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582218.970960:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dab9c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788582218.971474:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020913536 00000100:00100000:0.0:1788582218.971481:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020913536 00000100:00100000:0.0:1788582218.971519:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788582218.971528:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c81972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+18:15819:x1875464020913536:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788582218.971816:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c81972450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+18:15819:x1875464020913536:12345-0@lo:503:mount.lustre.0 Request processed in 288us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582218.971824:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788582218.971833:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020913536:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788582218.972500:0:15819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788582218.972571:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020913664:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788582218.972617:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582218.972693:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dab9c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788582218.972724:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020913664 00000100:00100000:0.0:1788582218.972730:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020913664 00000100:00100000:0.0:1788582218.973060:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788582218.973070:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c81972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+18:15819:x1875464020913664:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788582218.973612:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c81972050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+18:15819:x1875464020913664:12345-0@lo:502:mount.lustre.0 Request processed in 541us (992us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582218.973621:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788582218.973698:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020913664:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788582218.974028:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788582218.974082:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788582218.974125:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788582218.974158:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788582218.974192:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788582218.974686:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788582218.974721:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788582218.975810:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1788582218.975858:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020913792:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788582218.975956:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582218.975997:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dab9c2780 going to sleep for 11 seconds 00000100:00100000:0.0:1788582218.976100:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020913792 00000100:00100000:0.0:1788582218.976113:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020913792 00000100:00100000:0.0:1788582218.976167:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788582218.976176:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+18:15819:x1875464020913792:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788582218.976547:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd37850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+18:15819:x1875464020913792:12345-0@lo:502:mount.lustre.0 Request processed in 372us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582218.976555:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788582218.976644:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c0e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020913792:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788582218.976759:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788582218.976770:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1788582218.979483:0:15825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788582218.979494:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788582218.979496:0:15825:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788582218.979501:0:15825:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d0d9d88a000 00000020:00000080:3.0:1788582218.979502:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788582218.979507:0:15825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788582218.979509:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788582218.979510:0:15825:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788582218.979522:0:15825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788582218.979523:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788582218.979524:0:15825:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788582218.979526:0:15825:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d0d9d88a000 00000020:00000080:3.0:1788582218.979527:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788582218.979575:0:15825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788582218.979579:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788582218.979580:0:15825:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788582218.979583:0:15825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788582218.979585:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788582218.979586:0:15825:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788582218.979589:0:15825:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d0d9d88a000 00000020:00000080:3.0:1788582218.979591:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788582218.979624:0:15825:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788582218.979628:0:15825:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788582218.979629:0:15825:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1788582218.979631:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788582218.979859:0:15819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788582218.979896:0:15819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788582218.979922:0:15819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27a00/0x2bc3aa892c3a7e46 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7e4d expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582218.979943:0:15819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27a00/0x2bc3aa892c3a7e46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7e4d expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788582218.979987:0:15819:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788582218.979990:0:15819:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d0d9d88a000 10000000:01000000:1.0:1788582218.979993:0:15819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d0d9d88a000 10000000:01000000:1.0:1788582218.979997:0:15819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788582218.980003:0:15819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d0d9d88a000 from 1 10000000:01000000:1.0:1788582218.980011:0:15819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788582218.980050:0:15819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da71fc200/0x2bc3aa892c3a7e54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582218.980058:0:15819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0da71fc200/0x2bc3aa892c3a7e54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582218.980071:0:15819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0da71fc200/0x2bc3aa892c3a7e54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582218.980097:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020913920:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788582218.980165:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582218.980235:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d84ec8000 going to sleep for 11 seconds 00000100:00100000:3.0:1788582218.981037:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020913920 00000100:00100000:3.0:1788582218.981047:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020913920 00000100:00100000:3.0:1788582218.981103:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788582218.981114:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbd35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+18:15819:x1875464020913920:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788582218.981132:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582218.981147:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d88e27800/0x2bc3aa892c3a7e5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a7e54 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582218.981174:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d88e27800/0x2bc3aa892c3a7e5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7e54 expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582218.981185:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d88e27800/0x2bc3aa892c3a7e5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7e54 expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582218.981195:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d88e27800, rc 0) 00000100:00100000:3.0:1788582218.981276:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbd35050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+19:15819:x1875464020913920:12345-0@lo:101:mount.lustre.0 Request processed in 163us (1111us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582218.981283:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788582218.981461:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc2300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020913920:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788582218.981479:0:15819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0da71fc200/0x2bc3aa892c3a7e54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7e5b expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582218.981500:0:15819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0da71fc200/0x2bc3aa892c3a7e54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a7e5b expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788582218.983088:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1788582218.984068:0:15819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788582218.986045:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1788582218.986112:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1788582218.987462:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1788582218.988562:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1788582218.988613:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1788582218.989465:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1788582218.989531:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1788582218.989565:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1788582218.989615:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1788582218.989649:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1788582218.990855:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1788582218.990931:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1788582218.990971:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1788582218.991008:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1788582218.991057:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1788582218.991095:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1788582218.991129:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1788582218.991195:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1788582218.996901:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1788582218.997011:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1788582218.997092:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1788582218.997152:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1788582218.997190:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1788582218.999020:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1788582218.999090:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1788582218.999127:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1788582219.000020:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1788582219.000062:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1788582219.000110:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1788582219.000175:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1788582219.000245:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1788582219.002037:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1788582219.002086:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1788582219.002161:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1788582219.002197:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1788582219.002949:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1788582219.003000:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1788582219.003089:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1788582219.003096:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1788582219.003568:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020914048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788582219.003632:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582219.003858:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da3261780 going to sleep for 11 seconds 00000100:00100000:0.0:1788582219.003920:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020914048 00000100:00100000:0.0:1788582219.003928:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020914048 00000100:00100000:0.0:1788582219.003984:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788582219.003995:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d917e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+19:15819:x1875464020914048:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788582219.004795:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d917e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+19:15819:x1875464020914048:12345-0@lo:501:mount.lustre.0 Request processed in 799us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582219.004806:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788582219.004941:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020914048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788582219.006864:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020914176:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788582219.006949:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582219.007041:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da3261780 going to sleep for 11 seconds 00000100:00100000:0.0:1788582219.007100:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020914176 00000100:00100000:0.0:1788582219.007109:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020914176 00000100:00100000:0.0:1788582219.007575:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788582219.007586:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d917e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+19:15819:x1875464020914176:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788582219.007807:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d917e5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+19:15819:x1875464020914176:12345-0@lo:503:mount.lustre.0 Request processed in 223us (858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582219.007815:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788582219.008003:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020914176:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788582219.008634:0:15819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788582219.008935:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020914304:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788582219.008985:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582219.009022:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da3261780 going to sleep for 11 seconds 00000100:00100000:0.0:1788582219.009824:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020914304 00000100:00100000:0.0:1788582219.009832:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020914304 00000100:00100000:0.0:1788582219.009874:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788582219.009896:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+19:15819:x1875464020914304:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788582219.010131:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+19:15819:x1875464020914304:12345-0@lo:502:mount.lustre.0 Request processed in 236us (1145us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582219.010537:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020914304:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788582219.010952:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788582219.011043:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788582219.011076:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788582219.011120:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788582219.011168:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788582219.011243:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000100:00100000:0.0:1788582219.011402:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000040:00080000:2.0:1788582219.012820:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788582219.012867:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788582219.012948:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788582219.012986:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788582219.013024:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788582219.013070:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788582219.013104:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788582219.013152:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788582219.014247:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788582219.014831:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788582219.015557:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788582219.016563:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788582219.016629:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788582219.016836:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788582219.016908:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788582219.016944:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788582219.016979:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788582219.017028:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788582219.017065:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1788582219.017098:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1788582219.017160:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1788582219.017231:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1788582219.017289:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1788582219.017339:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1788582219.017378:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1788582219.017412:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1788582219.017463:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1788582219.017540:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1788582219.017588:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1788582219.017639:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1788582219.018518:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1788582219.018567:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1788582219.018631:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1788582219.019386:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1788582219.019519:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020914432:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788582219.019605:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582219.019917:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020914432 00000100:00100000:3.0:1788582219.019926:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020914432 00000100:00100000:2.0:1788582219.019940:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da3261780 going to sleep for 11 seconds 00000100:00100000:3.0:1788582219.019988:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788582219.020000:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+19:15819:x1875464020914432:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788582219.020243:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+19:15819:x1875464020914432:12345-0@lo:502:mount.lustre.0 Request processed in 245us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582219.020252:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788582219.020422:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020914432:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788582219.020603:0:15819:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788582219.020614:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788582219.024475:0:15830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788582219.024494:0:15830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d0d91a119b8) 00000020:00000080:3.0:1788582219.024516:0:15830:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788582219.024575:0:15830:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d0d9d88a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788582219.024578:0:15830:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d0d9d88a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788582219.024579:0:15830:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d0d9d88a000 3 00010000:00080000:3.0:1788582219.024620:0:15830:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d0d831d7000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.112@tcp at head 00010000:00010000:3.0:1788582219.027173:0:15830:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788582219.027672:0:15830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788582219.027719:0:15830:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788582219.027734:0:15830:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x2bc3aa892c3a7e69 00000100:00080000:3.0:1788582219.027746:0:15830:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788582219.027754:0:15830:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d0d831d7000 using connection 192.168.201.112@tcp/0@lo 00000100:00100000:3.0:1788582219.027797:0:15830:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0dac0c0e00 x1875464020914560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788582219.027825:0:15830:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788582219.028155:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788582219.028160:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788582219.028163:0:8:0:(import.c:65:import_set_state_nolock()) ffff8d0da7180000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788582219.028168:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 434 00000100:00080000:1.0:1788582219.028172:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788582219.028177:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d0da7180000 using connection 192.168.201.112@tcp/0@lo 00000100:00100000:2.0:1788582219.028183:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875464020914560:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788582219.028190:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0dbbdc0000 x1875464020914816/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788582219.028254:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875464020914944:0@lo:400:kworker.0 00000100:00100000:2.0:1788582219.028288:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582219.028341:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020914816:0@lo:8:kworker.0 00000100:00100000:2.0:1788582219.028367:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582219.028401:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020915072:0@lo:400:kworker.0 00000100:00100000:3.0:1788582219.028404:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020914688:0@lo:400:kworker.0 00000100:00100000:2.0:1788582219.028424:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582219.028438:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582219.028459:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020914560 00000100:00100000:2.0:1788582219.028467:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020914560 00000100:00100000:3.0:1788582219.028473:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020914816 00000100:00100000:3.0:1788582219.028476:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020914816 00000100:00100000:3.0:1788582219.028492:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020914688 00000100:00100000:2.0:1788582219.028492:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020915072 00000100:00100000:3.0:1788582219.028495:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020914688 00000100:00100000:2.0:1788582219.028495:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020915072 00000100:00100000:1.0:1788582219.028541:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788582219.028549:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1875464020914816:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788582219.028604:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3305:x1875464020914816:12345-0@lo:8:kworker.0 Request processed in 54us (236us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788582219.028611:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788582219.028686:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788582219.028694:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1875464020914688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582219.028737:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3306:x1875464020914688:12345-0@lo:400:kworker.0 Request processed in 44us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582219.028744:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788582219.028759:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788582219.028762:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1788582219.028763:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788582219.028770:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaeab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020915072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582219.028789:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020914688:0@lo:400:kworker.0 00000100:00100000:2.0:1788582219.028802:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaeab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020915072:12345-0@lo:400:kworker.0 Request processed in 34us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582219.028808:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788582219.028827:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788582219.028831:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1875464020914560:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788582219.028846:0:14421:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:2.0:1788582219.028891:0:14421:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x2bc3aa892c3a7e70 00000004:00100000:2.0:1788582219.028909:0:14421:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788582219.028935:0:14421:0:(import.c:65:import_set_state_nolock()) ffff8d0d9d9bf000 : changing import state from RECOVER to FULL 00000040:00080000:3.0:1788582219.028961:0:15830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:2.0:1788582219.028965:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1875464020914560:12345-0@lo:38:llog_process_th.0 Request processed in 133us (678us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582219.028971:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788582219.028988:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582219.029293:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020914944 00000100:00100000:2.0:1788582219.029343:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788582219.029349:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0da7180000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788582219.029353:0:3305:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788582219.029356:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020914816:0@lo:8:kworker.0 00000100:00100000:3.0:1788582219.029367:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020914944 00010000:00080000:2.0:1788582219.029368:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0dac0c0e00 x1875464020914560/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788582229 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788582219.029377:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788582219.029382:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788582219.029388:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00100000:3.0:1788582219.029389:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1788582219.029392:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788582219.029394:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0d831d7000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788582219.029396:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875464020914944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582219.029398:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3305:1875464020914560:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788582219.029436:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875464020914944:12345-0@lo:400:kworker.0 Request processed in 40us (446us total) trans 0 rc 0/0 00010000:00080000:2.0:1788582219.029439:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0dbbdc1880 x1875464020915072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788582235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788582219.029442:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788582219.029448:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020915072:0@lo:400:kworker.0 00000020:01000000:2.0:1788582219.029476:0:15819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788582219.029508:0:15819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00080000:1.0:1788582219.029527:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d0dbbdc0700 x1875464020914944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788582235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1788582219.029531:0:15819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0da71fc200/0x2bc3aa892c3a7e54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7e5b expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582219.029537:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875464020914944:0@lo:400:kworker.0 00010000:00010000:2.0:1788582219.029542:0:15819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0da71fc200/0x2bc3aa892c3a7e54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7e5b expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788582219.029599:0:15819:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788582219.029602:0:15819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788582219.029603:0:15819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788582219.029604:0:15819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788582219.029605:0:15819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788582219.029607:0:15819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788582219.029608:0:15819:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788582219.029610:0:15819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788582219.029611:0:15819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788582219.029615:0:15819:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1788582219.029618:0:15819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788582219.029619:0:15819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788582219.029620:0:15819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788582219.029622:0:15819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788582219.029623:0:15819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788582219.029624:0:15819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788582219.029625:0:15819:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788582219.029626:0:15819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788582219.029627:0:15819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788582219.029643:0:15819:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788582219.029670:0:15819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaeaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020915200:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788582219.029709:0:15819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582219.029742:0:15819:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da3261780 going to sleep for 11 seconds 00000100:00100000:1.0:1788582219.031902:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020915200 00000100:00100000:1.0:1788582219.031916:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020915200 00000100:00100000:1.0:1788582219.031990:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788582219.032001:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+19:15819:x1875464020915200:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788582219.032035:0:14414:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788582219.032052:0:14414:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788582219.055030:0:14414:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788582219.055078:0:14414:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788582219.057761:0:14436:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788582219.057772:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788582219.057794:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a7e77 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582219.057812:0:14436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0da7089400/0x2bc3aa892c3a7d4a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7d43 expref: 19 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582219.057839:0:14436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a7e77 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582219.057888:0:14436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0da7089400/0x2bc3aa892c3a7d4a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a7d43 expref: 19 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582219.057900:0:14436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d0da7089400/0x2bc3aa892c3a7d4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7d43 expref: 19 pid: 14414 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582219.057915:0:14436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14436:1875464020915328:0@lo:104: 00000100:00100000:3.0:1788582219.057977:0:14436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582219.058025:0:14436:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dac215a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788582219.058084:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020915328 00000100:00100000:2.0:1788582219.058092:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020915328 00000100:00100000:2.0:1788582219.058152:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788582219.058170:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9415e791-1a3c-4924-bcfc-d6d86718d620+3:14436:x1875464020915328:12345-0@lo:104: 00010000:00010000:2.0:1788582219.058181:0:14403:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0da71fca00/0x2bc3aa892c3a7d43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a7d4a expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582219.058484:0:14403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788582219.058491:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:9415e791-1a3c-4924-bcfc-d6d86718d620+3:14436:x1875464020915328:12345-0@lo:104: Request processed in 323us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582219.058500:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:1.0:1788582219.058550:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788582219.058557:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0da71fca00/0x2bc3aa892c3a7d43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a7d4a expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582219.058564:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fca00 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:1.0:1788582219.058568:0:14409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0da71fca00/0x2bc3aa892c3a7d43 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a7d4a expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582219.058575:0:14409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0da71fca00/0x2bc3aa892c3a7d43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a7d4a expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788582219.058582:0:14409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0da71fca00/0x2bc3aa892c3a7d43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a7d4a expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788582219.058587:0:14409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788582219.058626:0:14409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0da71fca00/0x2bc3aa892c3a7d43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a7d4a expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582219.058633:0:14409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788582219.058654:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0da71fca00/0x2bc3aa892c3a7d43 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a7d4a expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582219.058669:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0da71fca00/0x2bc3aa892c3a7d43 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a7d4a expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582219.058685:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582219.058687:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582219.058689:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582219.058702:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9415e791-1a3c-4924-bcfc-d6d86718d620:3309:1875464020915456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788582219.058733:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582219.058774:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020915456 00000100:00100000:1.0:1788582219.058779:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020915456 00010000:00010000:1.0:1788582219.058798:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0da7089400/0x2bc3aa892c3a7d4a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7d43 expref: 20 pid: 14414 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582219.058820:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788582219.058827:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9415e791-1a3c-4924-bcfc-d6d86718d620+20:3309:x1875464020915456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788582219.058837:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788582219.058841:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0da7089400/0x2bc3aa892c3a7d4a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7d43 expref: 20 pid: 14414 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582219.058850:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0da7089400/0x2bc3aa892c3a7d4a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7d43 expref: 20 pid: 14414 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582219.058866:0:14407:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a7e77 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582219.058873:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a7e77 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788582219.058897:0:14407:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005230988s 00010000:00010000:1.0:1788582219.058907:0:14407:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a7e77 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582219.058913:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a7e77 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582219.058920:0:14407:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a7e77 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582219.058926:0:14407:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a7e77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582219.058932:0:14407:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26400 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582219.058936:0:14407:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a7e77 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582219.058943:0:14407:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a7e77 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582219.058952:0:14407:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a7e77 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582219.058961:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788582219.058991:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9415e791-1a3c-4924-bcfc-d6d86718d620+20:3309:x1875464020915456:12345-0@lo:103:ldlm_bl.0 Request processed in 164us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582219.058998:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788582219.059040:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9415e791-1a3c-4924-bcfc-d6d86718d620:3309:1875464020915456:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788582219.059117:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0da7089400/0x2bc3aa892c3a7d4a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a7d43 expref: 19 pid: 14414 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582219.059127:0:14436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c2680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14436:1875464020915328:0@lo:104: 00010000:00010000:3.0:1788582219.059139:0:14436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a7e77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582219.059147:0:14436:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a7e77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582219.059152:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a7e77 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582219.059157:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d88e26400/0x2bc3aa892c3a7e77 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582219.063732:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+18:15819:x1875464020915200:12345-0@lo:253:mount.lustre.0 Request processed in 31723us (34011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582219.063749:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788582219.063850:0:15819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaeaaa00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:9415e791-1a3c-4924-bcfc-d6d86718d620:15819:1875464020915200:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788582219.063889:0:15819:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788582219.063894:0:15819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788582219.063896:0:15819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788582219.063897:0:15819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788582219.063899:0:15819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788582219.063900:0:15819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788582219.063901:0:15819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788582219.063902:0:15819:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788582219.063904:0:15819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788582219.063906:0:15819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788582219.063920:0:15819:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788582219.068740:0:15819:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1788582219.068923:0:15819:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788582219.069092:0:15819:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1788582219.069289:0:15819:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788582219.069450:0:15819:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1788582219.069664:0:15819:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1788582219.070613:0:15819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788582219.120932:0:15819:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788582219.120941:0:15819:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788582219.120981:0:15819:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788582219.121037:0:15819:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.112@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788582219.121053:0:15819:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788582219.121083:0:15819:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1788582219.245672:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582220.269503:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788582220.405017:0:6716:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1788582220.405031:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 10000000:01000000:2.0:1788582221.101728:0:14417:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788582221.101739:0:14417:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d0dbbdde000 from 8 10000000:01000000:2.0:1788582221.101744:0:14417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788582221.101792:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7e7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582221.101805:0:14417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7e7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582221.101818:0:14417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7e7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582221.101854:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020915584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788582221.101932:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582221.101986:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d84ec83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788582221.102010:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020915584 00000100:00100000:2.0:1788582221.102017:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020915584 00000100:00100000:2.0:1788582221.102083:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788582221.102108:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+18:14417:x1875464020915584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788582221.102123:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582221.102137:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0dbbe05800/0x2bc3aa892c3a7e85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a7e7e expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582221.102163:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0dbbe05800/0x2bc3aa892c3a7e85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7e7e expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582221.102174:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0dbbe05800/0x2bc3aa892c3a7e85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7e7e expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582221.102185:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05800, rc 0) 00000100:00100000:2.0:1788582221.102252:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+19:14417:x1875464020915584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582221.102260:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788582221.102305:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020915584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788582221.102319:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7e7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7e85 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582221.102328:0:14417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7e7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a7e85 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582221.102379:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbaea9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020915712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1788582221.102411:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582221.103426:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d84ec83c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788582221.103520:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020915712 00000100:00100000:2.0:1788582221.103525:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020915712 00000100:00100000:2.0:1788582221.103601:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788582221.103617:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+19:14417:x1875464020915712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788582221.103637:0:14414:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788582221.103652:0:14414:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788582221.103656:0:14414:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788582221.103750:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+19:14417:x1875464020915712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 134us (1337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582221.103759:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788582221.106676:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbaea9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020915712:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788582221.106763:0:14417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788582221.106774:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7e7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7e85 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582221.106786:0:14417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe04e00/0x2bc3aa892c3a7e7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7e85 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582221.297268:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:0.0:1788582221.297366:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582221.301387:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020915840:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788582221.301472:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582221.301604:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020915840 00000100:00100000:0.0:1788582221.301613:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020915840 00000100:00100000:0.0:1788582221.301686:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788582221.301696:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020915840:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788582221.301732:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582221.301779:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020915840:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582221.301787:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788582221.301846:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788582221.301905:0:3307:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788582221.301948:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020915840:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788582222.318599:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582223.344291:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788582223.726237:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1788582224.365385:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788582224.365392:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788582224.365396:0:37:0:(import.c:65:import_set_state_nolock()) ffff8d0da7180000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788582224.365408:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d0da7180000 using connection 192.168.201.112@tcp/0@lo 00000100:00100000:1.0:1788582224.365429:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d0dbbdc1180 x1875464020916224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788582224.365506:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020916096:0@lo:400:kworker.0 00000100:00100000:1.0:1788582224.365569:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582224.365621:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788582224.365626:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020916352:0@lo:400:kworker.0 00000100:00100000:1.0:1788582224.365646:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582224.365670:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020916224:0@lo:8:kworker.0 00000100:00100000:1.0:1788582224.365687:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788582224.365706:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582224.365719:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020916096 00000100:00100000:1.0:1788582224.365726:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020916096 00000100:00100000:1.0:1788582224.365774:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020916224 00000100:00100000:1.0:1788582224.365777:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020916224 00000100:00100000:1.0:1788582224.365804:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788582224.365813:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020916096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582224.365864:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020916096:12345-0@lo:400:kworker.0 Request processed in 53us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582224.365872:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788582224.365886:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788582224.365890:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3305:x1875464020916224:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788582224.365912:0:15106:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:1.0:1788582224.365948:0:15106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x2bc3aa892c3a7e8c 00002000:00100000:1.0:1788582224.365963:0:15106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d0d9d85e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113968 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788582224.365966:0:15106:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788582224.365969:0:15106:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788582224.366296:0:15106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788582224.366316:0:15106:0:(import.c:65:import_set_state_nolock()) ffff8d0d9d85f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788582224.366353:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1875464020916224:12345-0@lo:8:kworker.0 Request processed in 461us (664us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582224.366360:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788582224.366378:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020916352 00000100:00100000:1.0:1788582224.366382:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020916352 00000100:00100000:1.0:1788582224.366402:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788582224.366408:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020916352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582224.366434:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020916352:12345-0@lo:400:kworker.0 Request processed in 27us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582224.366439:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1788582224.366455:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788582224.366479:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbbdc1180 x1875464020916224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788582249 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788582224.366494:0:3305:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1788582224.366502:0:3305:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788582224.366507:0:3305:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1788582224.366509:0:3305:0:(import.c:65:import_set_state_nolock()) ffff8d0da7180000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788582224.366528:0:3305:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788582224.366533:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3305:1875464020916224:0@lo:8:kworker.0 00000004:00080000:1.0:1788582224.366571:0:14445:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1788582224.366591:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14445:1875464020916864:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1788582224.366613:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582224.366626:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da7194480 going to sleep for 11 seconds 00000100:00100000:1.0:1788582224.366635:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788582224.366641:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020916736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788582224.366659:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582224.366684:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020916736 00000100:00100000:1.0:1788582224.366687:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020916736 00000100:00100000:1.0:1788582224.366713:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788582224.366718:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875464020916736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788582224.366736:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788582224.366769:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875464020916736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (108us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582224.366775:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1788582224.366801:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788582224.366816:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbbdc1180 x1875464020916736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788582240 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788582224.366824:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020916480:0@lo:400:kworker.0 00000100:00100000:1.0:1788582224.366829:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020916736:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788582224.366851:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbbdc1c00 x1875464020916352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788582240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788582224.366855:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582224.366860:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020916352:0@lo:400:kworker.0 00000100:00100000:1.0:1788582224.366870:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020916096:0@lo:400:kworker.0 00000100:00100000:0.0:1788582224.366875:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788582224.366881:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9415e791-1a3c-4924-bcfc-d6d86718d620:3306:1875464020915968:0@lo:400:kworker.0 00000100:00100000:1.0:1788582224.366885:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020916864 00000100:00100000:1.0:1788582224.366888:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020916864 00000100:00100000:1.0:1788582224.366906:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788582224.366906:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582224.366919:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14445:x1875464020916864:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1788582224.366927:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020916608:0@lo:400:kworker.0 00000100:00100000:0.0:1788582224.366949:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788582224.368834:0:14444:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788582224.368881:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020916480 00000100:00100000:3.0:1788582224.368890:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020916480 00000100:00100000:3.0:1788582224.368931:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020916608 00000100:00100000:3.0:1788582224.368934:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020916608 00000100:00100000:3.0:1788582224.368952:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788582224.368960:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020916480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582224.369032:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf375500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1875464020916480:12345-0@lo:400:kworker.0 Request processed in 72us (2175us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582224.369045:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788582224.369060:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788582224.369065:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020916608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582224.369093:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf375c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1875464020916608:12345-0@lo:400:kworker.0 Request processed in 28us (2143us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582224.369099:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788582224.369116:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020915968 00000100:00100000:3.0:1788582224.369119:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020915968 00000100:00100000:3.0:1788582224.369142:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788582224.369148:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+19:3306:x1875464020915968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582224.369176:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+19:3306:x1875464020915968:12345-0@lo:400:kworker.0 Request processed in 29us (2269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582224.369182:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000004:00080000:2.0:1788582224.369221:0:14444:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 443363017883ns, next at 0ns, rc = 0 00000100:00080000:3.0:1788582224.369267:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788582224.369995:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9415e791-1a3c-4924-bcfc-d6d86718d620:3306:1875464020915968:0@lo:400:kworker.0 00010000:00080000:3.0:1788582224.370015:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbbdc0000 x1875464020916608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788582240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788582224.370026:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3306:1875464020916608:0@lo:400:kworker.0 00010000:00080000:3.0:1788582224.370039:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d0dbbdc1880 x1875464020916480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788582240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788582224.370046:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3306:1875464020916480:0@lo:400:kworker.0 00002000:00080000:1.0:1788582224.375947:0:15106:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1788582224.375960:0:15106:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788582224.375966:0:15106:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00002000:00010000:1.0:1788582224.384920:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788582224.384932:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a7e93 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.384952:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1788582224.384957:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582224.384963:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a7e93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.384983:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a7e93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.384994:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a7e93 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.385001:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a7e93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.385156:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788582224.385902:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582224.385910:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a7e93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.385930:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd800 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582224.385935:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a7e93 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.385944:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a7e93 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.385962:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a7e93 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.385969:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a7e93 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.385988:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582224.385990:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582224.385991:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788582224.390497:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788582224.390514:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5476f94/0x2bc3aa892c3a7e9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.390544:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1788582224.390549:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582224.390555:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a5476f94/0x2bc3aa892c3a7e9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.390569:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a5476f94/0x2bc3aa892c3a7e9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.390579:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a5476f94/0x2bc3aa892c3a7e9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.390587:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a5476f94/0x2bc3aa892c3a7e9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.390614:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788582224.391085:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788582224.391091:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae290eae/0x2bc3aa892c3a7ea1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.391099:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1788582224.391103:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582224.391106:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae290eae/0x2bc3aa892c3a7ea1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.391115:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae290eae/0x2bc3aa892c3a7ea1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.391134:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae290eae/0x2bc3aa892c3a7ea1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.391141:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae290eae/0x2bc3aa892c3a7ea1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.391158:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1788582224.391551:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788582224.391557:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e69afcbb/0x2bc3aa892c3a7ea8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.391565:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1788582224.391569:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582224.391573:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e69afcbb/0x2bc3aa892c3a7ea8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.391582:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e69afcbb/0x2bc3aa892c3a7ea8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.391589:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e69afcbb/0x2bc3aa892c3a7ea8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.391596:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e69afcbb/0x2bc3aa892c3a7ea8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.391615:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1788582224.392004:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788582224.392010:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7eaf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.392019:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1788582224.392023:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582224.392026:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7eaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.392035:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7eaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.392042:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7eaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.392049:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7eaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.392057:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:2.0:1788582224.392090:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788582224.392097:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a5476f94/0x2bc3aa892c3a7e9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392106:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fda00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582224.392110:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5476f94/0x2bc3aa892c3a7e9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392120:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a5476f94/0x2bc3aa892c3a7e9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392143:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a5476f94/0x2bc3aa892c3a7e9a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392151:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a5476f94/0x2bc3aa892c3a7e9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392168:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788582224.392172:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae290eae/0x2bc3aa892c3a7ea1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392179:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd600 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582224.392182:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae290eae/0x2bc3aa892c3a7ea1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392191:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae290eae/0x2bc3aa892c3a7ea1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392215:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae290eae/0x2bc3aa892c3a7ea1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392223:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae290eae/0x2bc3aa892c3a7ea1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392234:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788582224.392237:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e69afcbb/0x2bc3aa892c3a7ea8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392249:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fca00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582224.392253:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e69afcbb/0x2bc3aa892c3a7ea8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392260:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e69afcbb/0x2bc3aa892c3a7ea8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392270:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e69afcbb/0x2bc3aa892c3a7ea8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392276:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e69afcbb/0x2bc3aa892c3a7ea8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392287:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582224.392290:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7eaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392295:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fc600 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582224.392298:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7eaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392303:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7eaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392310:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7eaf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392324:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000163b25a7/0x2bc3aa892c3a7eaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392336:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582224.392338:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582224.392339:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788582224.392426:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788582224.392432:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c48b440/0x2bc3aa892c3a7eb6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.392440:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1788582224.392448:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582224.392452:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009c48b440/0x2bc3aa892c3a7eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.392463:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009c48b440/0x2bc3aa892c3a7eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.392471:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009c48b440/0x2bc3aa892c3a7eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.392478:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009c48b440/0x2bc3aa892c3a7eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.392491:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788582224.392502:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788582224.392507:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009c48b440/0x2bc3aa892c3a7eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392514:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fce00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:2.0:1788582224.392517:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009c48b440/0x2bc3aa892c3a7eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392525:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009c48b440/0x2bc3aa892c3a7eb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392536:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009c48b440/0x2bc3aa892c3a7eb6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392543:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009c48b440/0x2bc3aa892c3a7eb6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582224.392555:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582224.392557:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788582224.392558:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582224.392854:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788582224.392900:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788582224.392908:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7ebd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.392916:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1788582224.392918:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582224.392922:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7ebd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.392930:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7ebd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.392937:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7ebd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.392948:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7ebd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.392971:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788582224.393059:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788582224.393065:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7ebd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.393072:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fde00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:0.0:1788582224.393082:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7ebd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.393090:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7ebd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.393104:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7ebd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.393111:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c3720d4/0x2bc3aa892c3a7ebd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.393125:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582224.393126:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582224.393128:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788582224.393373:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788582224.393378:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003699727a/0x2bc3aa892c3a7ec4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.393386:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1788582224.393389:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582224.393393:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003699727a/0x2bc3aa892c3a7ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.393402:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003699727a/0x2bc3aa892c3a7ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.393409:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003699727a/0x2bc3aa892c3a7ec4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.393417:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003699727a/0x2bc3aa892c3a7ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.393438:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788582224.393769:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788582224.393775:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d29a570/0x2bc3aa892c3a7ecb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.396912:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1788582224.396918:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582224.396926:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001d29a570/0x2bc3aa892c3a7ecb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.396945:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001d29a570/0x2bc3aa892c3a7ecb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.396956:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001d29a570/0x2bc3aa892c3a7ecb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.396965:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001d29a570/0x2bc3aa892c3a7ecb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.396987:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788582224.397002:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788582224.397008:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003699727a/0x2bc3aa892c3a7ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.397015:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd000 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582224.397020:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003699727a/0x2bc3aa892c3a7ec4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.397029:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003699727a/0x2bc3aa892c3a7ec4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.397059:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003699727a/0x2bc3aa892c3a7ec4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.397066:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003699727a/0x2bc3aa892c3a7ec4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.397088:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788582224.397091:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001d29a570/0x2bc3aa892c3a7ecb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.397097:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd200 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582224.397100:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001d29a570/0x2bc3aa892c3a7ecb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.397106:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001d29a570/0x2bc3aa892c3a7ecb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.397114:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001d29a570/0x2bc3aa892c3a7ecb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.397119:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001d29a570/0x2bc3aa892c3a7ecb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.397128:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582224.397129:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582224.397135:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788582224.398157:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788582224.398166:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2a78ca3/0x2bc3aa892c3a7ed2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.399298:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1788582224.399302:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582224.399310:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a78ca3/0x2bc3aa892c3a7ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.399325:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e2a78ca3/0x2bc3aa892c3a7ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.399337:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e2a78ca3/0x2bc3aa892c3a7ed2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.399345:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e2a78ca3/0x2bc3aa892c3a7ed2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.399363:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788582224.399375:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788582224.399380:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e2a78ca3/0x2bc3aa892c3a7ed2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.399388:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fdc00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582224.399393:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2a78ca3/0x2bc3aa892c3a7ed2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.399415:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e2a78ca3/0x2bc3aa892c3a7ed2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.399431:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e2a78ca3/0x2bc3aa892c3a7ed2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.399439:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e2a78ca3/0x2bc3aa892c3a7ed2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.399462:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582224.399464:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582224.399465:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788582224.400085:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788582224.400093:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a7ed9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.400102:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1788582224.400106:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582224.400110:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a7ed9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.400120:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a7ed9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.400129:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a7ed9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.400141:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a7ed9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.400155:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788582224.400163:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788582224.400167:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a7ed9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.400263:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da71fd800 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582224.400267:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a7ed9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.400276:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a7ed9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.400288:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a7ed9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.400296:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a01b0c9f/0x2bc3aa892c3a7ed9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.400310:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582224.400312:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582224.400314:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788582224.400835:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788582224.400846:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000662e76db/0x2bc3aa892c3a7ee0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.400855:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1788582224.400859:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582224.400864:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000662e76db/0x2bc3aa892c3a7ee0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.400874:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000662e76db/0x2bc3aa892c3a7ee0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.400883:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000662e76db/0x2bc3aa892c3a7ee0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.400890:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000662e76db/0x2bc3aa892c3a7ee0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.400903:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788582224.400910:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788582224.400914:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000662e76db/0x2bc3aa892c3a7ee0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.400921:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0c81a81000 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582224.400924:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000662e76db/0x2bc3aa892c3a7ee0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.400932:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000662e76db/0x2bc3aa892c3a7ee0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.400950:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000662e76db/0x2bc3aa892c3a7ee0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.400958:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000662e76db/0x2bc3aa892c3a7ee0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.400972:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582224.400974:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582224.400976:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788582224.401383:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788582224.401389:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c8598bf/0x2bc3aa892c3a7ee7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.401397:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1788582224.401400:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788582224.401404:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006c8598bf/0x2bc3aa892c3a7ee7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.401414:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006c8598bf/0x2bc3aa892c3a7ee7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.401424:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006c8598bf/0x2bc3aa892c3a7ee7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.401431:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006c8598bf/0x2bc3aa892c3a7ee7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.401453:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788582224.401462:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788582224.401465:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006c8598bf/0x2bc3aa892c3a7ee7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.401473:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0c81a81a00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582224.401477:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006c8598bf/0x2bc3aa892c3a7ee7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.402498:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582224.403965:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006c8598bf/0x2bc3aa892c3a7ee7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.403991:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006c8598bf/0x2bc3aa892c3a7ee7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.403998:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006c8598bf/0x2bc3aa892c3a7ee7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.404257:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582224.404261:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582224.404263:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788582224.404938:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1788582224.412655:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788582224.412672:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e446eb0f/0x2bc3aa892c3a7eee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.412691:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1788582224.412696:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582224.412702:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e446eb0f/0x2bc3aa892c3a7eee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.412717:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e446eb0f/0x2bc3aa892c3a7eee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.412743:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e446eb0f/0x2bc3aa892c3a7eee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.412752:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e446eb0f/0x2bc3aa892c3a7eee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.412772:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788582224.415281:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788582224.415293:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089a4c5dd/0x2bc3aa892c3a7ef5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.415314:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1788582224.415319:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582224.415326:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000089a4c5dd/0x2bc3aa892c3a7ef5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.415340:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000089a4c5dd/0x2bc3aa892c3a7ef5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.415351:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000089a4c5dd/0x2bc3aa892c3a7ef5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.415359:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000089a4c5dd/0x2bc3aa892c3a7ef5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.415375:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788582224.415697:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788582224.415707:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e446eb0f/0x2bc3aa892c3a7eee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.415716:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2e00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:0.0:1788582224.415721:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e446eb0f/0x2bc3aa892c3a7eee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.415731:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e446eb0f/0x2bc3aa892c3a7eee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.415749:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e446eb0f/0x2bc3aa892c3a7eee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.415758:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e446eb0f/0x2bc3aa892c3a7eee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.415776:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788582224.415796:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000089a4c5dd/0x2bc3aa892c3a7ef5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.415803:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26400 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:0.0:1788582224.415807:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000089a4c5dd/0x2bc3aa892c3a7ef5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.415815:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000089a4c5dd/0x2bc3aa892c3a7ef5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.415826:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000089a4c5dd/0x2bc3aa892c3a7ef5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.415834:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089a4c5dd/0x2bc3aa892c3a7ef5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.415847:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582224.415849:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582224.415850:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582224.415930:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788582224.416331:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788582224.416338:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f29f005/0x2bc3aa892c3a7efc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.416347:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1788582224.416350:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582224.416354:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000f29f005/0x2bc3aa892c3a7efc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.416364:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000f29f005/0x2bc3aa892c3a7efc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.416383:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000f29f005/0x2bc3aa892c3a7efc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.416389:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000f29f005/0x2bc3aa892c3a7efc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.416401:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788582224.416854:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788582224.416860:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000f29f005/0x2bc3aa892c3a7efc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.416869:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27c00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:0.0:1788582224.416873:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000f29f005/0x2bc3aa892c3a7efc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.416891:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000f29f005/0x2bc3aa892c3a7efc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.416904:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000f29f005/0x2bc3aa892c3a7efc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.416911:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000f29f005/0x2bc3aa892c3a7efc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.416925:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582224.416927:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582224.416928:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788582224.417092:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788582224.417097:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7f03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.417105:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1788582224.417108:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582224.417112:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7f03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.417121:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7f03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.417128:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7f03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.417135:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7f03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.417167:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788582224.417829:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788582224.417836:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061c60460/0x2bc3aa892c3a7f0a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.417845:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1788582224.417847:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582224.417852:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061c60460/0x2bc3aa892c3a7f0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.417861:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061c60460/0x2bc3aa892c3a7f0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.417869:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061c60460/0x2bc3aa892c3a7f0a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.417875:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061c60460/0x2bc3aa892c3a7f0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.417932:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788582224.418365:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788582224.418371:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006514b1a3/0x2bc3aa892c3a7f11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.418379:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1788582224.418386:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582224.418391:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006514b1a3/0x2bc3aa892c3a7f11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.418399:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006514b1a3/0x2bc3aa892c3a7f11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.418406:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006514b1a3/0x2bc3aa892c3a7f11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.418413:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006514b1a3/0x2bc3aa892c3a7f11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.419320:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788582224.419329:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7f03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.419351:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26200 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582224.419356:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7f03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.419365:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7f03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.419382:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7f03 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.419389:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007d207f02/0x2bc3aa892c3a7f03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.419410:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788582224.419414:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061c60460/0x2bc3aa892c3a7f0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.419420:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26c00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582224.419423:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061c60460/0x2bc3aa892c3a7f0a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.419430:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061c60460/0x2bc3aa892c3a7f0a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.419439:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061c60460/0x2bc3aa892c3a7f0a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.419451:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061c60460/0x2bc3aa892c3a7f0a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.419463:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788582224.419466:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006514b1a3/0x2bc3aa892c3a7f11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.419472:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27200 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582224.419475:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006514b1a3/0x2bc3aa892c3a7f11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.419494:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006514b1a3/0x2bc3aa892c3a7f11 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.419503:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006514b1a3/0x2bc3aa892c3a7f11 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.419509:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582224.419511:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582224.419513:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582224.419973:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582224.421903:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788582224.421915:0:15106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006514b1a3/0x2bc3aa892c3a7f11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.423356:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788582224.423869:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788582224.423877:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007922e9b5/0x2bc3aa892c3a7f18 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.423893:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1788582224.423897:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582224.423903:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007922e9b5/0x2bc3aa892c3a7f18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.423915:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007922e9b5/0x2bc3aa892c3a7f18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.423932:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007922e9b5/0x2bc3aa892c3a7f18 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.423940:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007922e9b5/0x2bc3aa892c3a7f18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.423953:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788582224.423962:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788582224.423968:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007922e9b5/0x2bc3aa892c3a7f18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.423976:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26e00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:0.0:1788582224.423980:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007922e9b5/0x2bc3aa892c3a7f18 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.423990:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007922e9b5/0x2bc3aa892c3a7f18 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.424008:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007922e9b5/0x2bc3aa892c3a7f18 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.424025:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007922e9b5/0x2bc3aa892c3a7f18 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.424042:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582224.424044:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582224.424045:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788582224.424842:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788582224.424849:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbd51361/0x2bc3aa892c3a7f1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.424859:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1788582224.424863:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582224.424867:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cbd51361/0x2bc3aa892c3a7f1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.424877:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cbd51361/0x2bc3aa892c3a7f1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.424885:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cbd51361/0x2bc3aa892c3a7f1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.424891:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cbd51361/0x2bc3aa892c3a7f1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.424923:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788582224.425324:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788582224.425331:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cbd51361/0x2bc3aa892c3a7f1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.425340:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27000 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582224.425351:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbd51361/0x2bc3aa892c3a7f1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.425361:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cbd51361/0x2bc3aa892c3a7f1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.425375:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cbd51361/0x2bc3aa892c3a7f1f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.425384:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cbd51361/0x2bc3aa892c3a7f1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.425402:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582224.425404:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582224.425406:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788582224.425775:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788582224.425782:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb30ca78/0x2bc3aa892c3a7f26 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.425806:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1788582224.425810:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582224.425814:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cb30ca78/0x2bc3aa892c3a7f26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.425823:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cb30ca78/0x2bc3aa892c3a7f26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.425830:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cb30ca78/0x2bc3aa892c3a7f26 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.425837:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cb30ca78/0x2bc3aa892c3a7f26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.425850:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788582224.426047:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788582224.426053:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cb30ca78/0x2bc3aa892c3a7f26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.426060:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8138e400 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:0.0:1788582224.426064:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb30ca78/0x2bc3aa892c3a7f26 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.426072:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cb30ca78/0x2bc3aa892c3a7f26 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.426083:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cb30ca78/0x2bc3aa892c3a7f26 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.426090:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cb30ca78/0x2bc3aa892c3a7f26 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.426103:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582224.426105:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582224.426106:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788582224.426673:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788582224.426680:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dbfaf90/0x2bc3aa892c3a7f2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.426689:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1788582224.426697:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582224.426701:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002dbfaf90/0x2bc3aa892c3a7f2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.426711:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002dbfaf90/0x2bc3aa892c3a7f2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.426718:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002dbfaf90/0x2bc3aa892c3a7f2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.426725:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002dbfaf90/0x2bc3aa892c3a7f2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.426778:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788582224.427752:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788582224.427760:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c8e01db/0x2bc3aa892c3a7f34 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.427771:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1788582224.427775:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582224.427779:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c8e01db/0x2bc3aa892c3a7f34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.427803:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c8e01db/0x2bc3aa892c3a7f34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.427811:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003c8e01db/0x2bc3aa892c3a7f34 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.427826:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003c8e01db/0x2bc3aa892c3a7f34 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.428402:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788582224.428410:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002dbfaf90/0x2bc3aa892c3a7f2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.428417:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8138ea00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582224.428421:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002dbfaf90/0x2bc3aa892c3a7f2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.428430:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002dbfaf90/0x2bc3aa892c3a7f2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.428445:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002dbfaf90/0x2bc3aa892c3a7f2d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.428459:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002dbfaf90/0x2bc3aa892c3a7f2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.428491:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788582224.428495:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003c8e01db/0x2bc3aa892c3a7f34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.428501:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8138fc00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582224.428504:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003c8e01db/0x2bc3aa892c3a7f34 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.428510:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003c8e01db/0x2bc3aa892c3a7f34 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.428519:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003c8e01db/0x2bc3aa892c3a7f34 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.428525:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582224.428527:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582224.428529:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582224.428699:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788582224.428704:0:15106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c8e01db/0x2bc3aa892c3a7f34 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582224.428943:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788582224.429758:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1788582224.430346:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788582224.430357:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069e4d0ef/0x2bc3aa892c3a7f3b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.430370:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1788582224.430374:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582224.430379:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069e4d0ef/0x2bc3aa892c3a7f3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.430390:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069e4d0ef/0x2bc3aa892c3a7f3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.430400:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069e4d0ef/0x2bc3aa892c3a7f3b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.430407:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069e4d0ef/0x2bc3aa892c3a7f3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.430473:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788582224.430960:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788582224.430967:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088d63091/0x2bc3aa892c3a7f42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.430975:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1788582224.430978:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582224.430981:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088d63091/0x2bc3aa892c3a7f42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.430990:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088d63091/0x2bc3aa892c3a7f42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.430997:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088d63091/0x2bc3aa892c3a7f42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.431003:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088d63091/0x2bc3aa892c3a7f42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.432913:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788582224.432925:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069e4d0ef/0x2bc3aa892c3a7f3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.432938:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8138f200 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582224.432967:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069e4d0ef/0x2bc3aa892c3a7f3b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.432978:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069e4d0ef/0x2bc3aa892c3a7f3b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.433001:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069e4d0ef/0x2bc3aa892c3a7f3b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.433008:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069e4d0ef/0x2bc3aa892c3a7f3b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.433033:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788582224.433037:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088d63091/0x2bc3aa892c3a7f42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.433043:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8138fa00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582224.433045:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088d63091/0x2bc3aa892c3a7f42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.433052:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088d63091/0x2bc3aa892c3a7f42 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.433060:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088d63091/0x2bc3aa892c3a7f42 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.433066:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582224.433074:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582224.433076:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582224.434349:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788582224.434361:0:15106:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088d63091/0x2bc3aa892c3a7f42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.434567:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788582224.435105:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788582224.435112:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e305752/0x2bc3aa892c3a7f49 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.435132:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1788582224.435136:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582224.435141:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000e305752/0x2bc3aa892c3a7f49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.435153:0:15106:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000e305752/0x2bc3aa892c3a7f49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.435163:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000e305752/0x2bc3aa892c3a7f49 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.435441:0:15106:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000e305752/0x2bc3aa892c3a7f49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582224.435549:0:15106:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788582224.435739:0:15106:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:3.0:1788582224.435859:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14445:x1875464020916864:12345-0@lo:5:osp-pre-1-0.0 Request processed in 68935us (69239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582224.435870:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788582224.435925:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc3100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14445:1875464020916864:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788582224.436004:0:14445:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:3.0:1788582224.436050:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14445:1875464020916992:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788582224.436085:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582224.436122:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dac215c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788582224.436142:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020916992 00000100:00100000:3.0:1788582224.436147:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020916992 00000100:00100000:3.0:1788582224.436281:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788582224.436292:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14445:x1875464020916992:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788582224.436334:0:15107:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1788582224.437016:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788582224.437024:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000e305752/0x2bc3aa892c3a7f49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.437033:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8138e600 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582224.437038:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000e305752/0x2bc3aa892c3a7f49 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.437047:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000e305752/0x2bc3aa892c3a7f49 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.437064:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000e305752/0x2bc3aa892c3a7f49 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.437071:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000e305752/0x2bc3aa892c3a7f49 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582224.437091:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582224.437092:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582224.437094:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582224.446964:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c2680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14445:1875464020916992:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1788582224.446987:0:14445:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1788582224.447305:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14445:x1875464020916992:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10908us (11113us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1788582224.447317:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000001:02000400:1.0:1788582225.277439:0:16178:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg112-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788582225.392077:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582226.413426:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582226.413653:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020917120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788582226.413720:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582226.414736:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020917120 00000100:00100000:0.0:1788582226.414745:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020917120 00000100:00100000:0.0:1788582226.414879:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788582226.414889:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020917120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788582226.414925:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582226.414974:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875464020917120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582226.414981:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788582226.415021:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf375f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020917120:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788582226.418488:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788582227.281712:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582227.281783:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002052096 00000100:00100000:0.0:1788582227.281794:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002052096 00000100:00100000:0.0:1788582227.281838:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 74 00000100:00100000:0.0:1788582227.281848:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2348:x1875464002052096:12345-192.168.201.12@tcp:250:mount.lustre.0 00010000:00080000:0.0:1788582227.281881:0:14415:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 7c32afc4-6db4-4783-a556-081dabcc0c13@192.168.201.12@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:0.0:1788582227.281911:0:14415:0:(genops.c:1385:class_connect()) connect: client 7c32afc4-6db4-4783-a556-081dabcc0c13, cookie 0x2bc3aa892c3a7f50 00000100:00080000:0.0:1788582227.282061:0:14415:0:(import.c:65:import_set_state_nolock()) ffff8d0dbf4e9000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788582227.282160:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c32afc4-6db4-4783-a556-081dabcc0c13+5:2348:x1875464002052096:12345-192.168.201.12@tcp:250:mount.lustre.0 Request processed in 311us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582227.282169:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 74 00000100:00100000:0.0:1788582227.285371:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582227.285476:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002052224 00000100:00100000:3.0:1788582227.285487:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002052224 00000100:00100000:3.0:1788582227.285544:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 75 00000100:00100000:3.0:1788582227.285555:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+5:13739:x1875464002052224:12345-192.168.201.12@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788582227.285573:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582227.285590:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8138fc00/0x2bc3aa892c3a7f57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c949e expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582227.285622:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8138fc00/0x2bc3aa892c3a7f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c949e expref: 6 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582227.285633:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8138fc00/0x2bc3aa892c3a7f57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c949e expref: 6 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582227.285644:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8138fc00, rc 0) 00000100:00100000:3.0:1788582227.285717:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+6:13739:x1875464002052224:12345-192.168.201.12@tcp:101:mount.lustre.0 Request processed in 163us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582227.285724:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 75 00000100:00100000:1.0:1788582227.287823:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582227.288139:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002052352 00000100:00100000:3.0:1788582227.288150:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002052352 00000100:00100000:3.0:1788582227.288238:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 76 00000100:00100000:3.0:1788582227.288248:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+6:13739:x1875464002052352:12345-192.168.201.12@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788582227.288619:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+6:13739:x1875464002052352:12345-192.168.201.12@tcp:501:mount.lustre.0 Request processed in 370us (802us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788582227.288628:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 76 00000100:00100000:1.0:1788582227.291055:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582227.291162:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002052480 00000100:00100000:0.0:1788582227.291171:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002052480 00000100:00100000:0.0:1788582227.291259:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 77 00000100:00100000:0.0:1788582227.291270:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c32afc4-6db4-4783-a556-081dabcc0c13+6:13739:x1875464002052480:12345-192.168.201.12@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788582227.291287:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582227.291318:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d9d8e3c00/0x2bc3aa892c3a7f5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c94a5 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582227.291350:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d9d8e3c00/0x2bc3aa892c3a7f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c94a5 expref: 7 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582227.291362:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d9d8e3c00/0x2bc3aa892c3a7f5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c94a5 expref: 7 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582227.291372:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d9d8e3c00, rc 0) 00000100:00100000:0.0:1788582227.291424:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c32afc4-6db4-4783-a556-081dabcc0c13+7:13739:x1875464002052480:12345-192.168.201.12@tcp:101:mount.lustre.0 Request processed in 155us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582227.291431:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 77 00000100:00100000:0.0:1788582227.301007:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582227.301112:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002052608 00000100:00100000:2.0:1788582227.301133:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002052608 00000100:00100000:2.0:1788582227.301194:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 78 00000100:00100000:2.0:1788582227.301242:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+7:13739:x1875464002052608:12345-192.168.201.12@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788582227.301535:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+8:13739:x1875464002052608:12345-192.168.201.12@tcp:501:mount.lustre.0 Request processed in 331us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582227.301544:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 78 00000100:00100000:1.0:1788582227.303509:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582227.303582:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002052736 00000100:00100000:3.0:1788582227.303592:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002052736 00000100:00100000:3.0:1788582227.303640:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 79 00000100:00100000:3.0:1788582227.303649:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+8:13739:x1875464002052736:12345-192.168.201.12@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788582227.304057:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+8:13739:x1875464002052736:12345-192.168.201.12@tcp:503:mount.lustre.0 Request processed in 408us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582227.304065:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 79 00000100:00100000:1.0:1788582227.306371:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582227.306551:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002052864 00000100:00100000:0.0:1788582227.306562:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002052864 00000100:00100000:0.0:1788582227.306614:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 80 00000100:00100000:0.0:1788582227.306624:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c32afc4-6db4-4783-a556-081dabcc0c13+8:13757:x1875464002052864:12345-192.168.201.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788582227.307011:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c32afc4-6db4-4783-a556-081dabcc0c13+8:13757:x1875464002052864:12345-192.168.201.12@tcp:502:llog_process_th.0 Request processed in 386us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582227.307020:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 80 00000100:00100000:0.0:1788582227.333302:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582227.333441:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002052992 00000100:00100000:2.0:1788582227.333453:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002052992 00000100:00100000:2.0:1788582227.333509:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 81 00000100:00100000:2.0:1788582227.333521:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db775f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c32afc4-6db4-4783-a556-081dabcc0c13+8:13757:x1875464002052992:12345-192.168.201.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788582227.333825:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db775f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c32afc4-6db4-4783-a556-081dabcc0c13+8:13757:x1875464002052992:12345-192.168.201.12@tcp:502:llog_process_th.0 Request processed in 306us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582227.333834:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 81 00000100:00100000:1.0:1788582227.339991:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582227.340571:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002053120 00000100:00100000:2.0:1788582227.340583:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002053120 00000100:00100000:2.0:1788582227.340644:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 82 00000100:00100000:2.0:1788582227.340655:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+8:13739:x1875464002053120:12345-192.168.201.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788582227.340680:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582227.340698:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0dbbe05c00/0x2bc3aa892c3a7f65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c94cf expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582227.340727:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0dbbe05c00/0x2bc3aa892c3a7f65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c94cf expref: 9 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582227.340749:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0dbbe05c00/0x2bc3aa892c3a7f65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c94cf expref: 9 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582227.340772:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05c00, rc 0) 00000100:00100000:2.0:1788582227.340840:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+9:13739:x1875464002053120:12345-192.168.201.12@tcp:101:mount.lustre.0 Request processed in 186us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582227.340848:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 82 00000100:00100000:1.0:1788582227.353511:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582227.353605:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002053248 00000100:00100000:3.0:1788582227.353616:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002053248 00000100:00100000:3.0:1788582227.353683:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 83 00000100:00100000:3.0:1788582227.353695:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+9:13739:x1875464002053248:12345-192.168.201.12@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788582227.353723:0:14413:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788582227.353755:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788582227.353760:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788582227.353764:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788582227.353766:0:14413:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788582227.355756:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+9:13739:x1875464002053248:12345-192.168.201.12@tcp:256:mount.lustre.0 Request processed in 2044us (2241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582227.355770:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 83 00000100:00100000:1.0:1788582227.358531:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582227.358621:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002053376 00000100:00100000:0.0:1788582227.358632:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002053376 00000100:00100000:0.0:1788582227.358698:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 84 00000100:00100000:0.0:1788582227.358716:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c32afc4-6db4-4783-a556-081dabcc0c13+9:13739:x1875464002053376:12345-192.168.201.12@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788582227.358732:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582227.358762:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a7f6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c94d6 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582227.358794:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a7f6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c94d6 expref: 10 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582227.358806:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a7f6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c94d6 expref: 10 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582227.358815:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d9d8e3a00, rc 0) 00000100:00100000:0.0:1788582227.358876:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c32afc4-6db4-4783-a556-081dabcc0c13+10:13739:x1875464002053376:12345-192.168.201.12@tcp:101:mount.lustre.0 Request processed in 162us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582227.358882:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 84 00000100:00100000:1.0:1788582227.360555:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582227.361876:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002053504 00000100:00100000:0.0:1788582227.361891:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002053504 00000100:00100000:0.0:1788582227.362016:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 85 00000100:00100000:0.0:1788582227.362038:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+10:13739:x1875464002053504:12345-192.168.201.12@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788582227.362606:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+10:13739:x1875464002053504:12345-192.168.201.12@tcp:501:mount.lustre.0 Request processed in 568us (2054us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582227.362614:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 85 00000100:00100000:3.0:1788582227.364606:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582227.365135:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002053632 00000100:00100000:2.0:1788582227.365146:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002053632 00000100:00100000:2.0:1788582227.365196:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 86 00000100:00100000:2.0:1788582227.365221:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+10:13739:x1875464002053632:12345-192.168.201.12@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788582227.369068:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+10:13739:x1875464002053632:12345-192.168.201.12@tcp:503:mount.lustre.0 Request processed in 3835us (4457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582227.369082:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 86 00000100:00100000:2.0:1788582227.373319:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582227.374252:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002053760 00000100:00100000:3.0:1788582227.374265:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002053760 00000100:00100000:3.0:1788582227.374328:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 87 00000100:00100000:3.0:1788582227.374337:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+10:13759:x1875464002053760:12345-192.168.201.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788582227.374618:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+10:13759:x1875464002053760:12345-192.168.201.12@tcp:502:llog_process_th.0 Request processed in 280us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582227.374628:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 87 00000100:00100000:2.0:1788582227.376558:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582227.376666:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002053888 00000100:00100000:1.0:1788582227.376676:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002053888 00000100:00100000:0.0:1788582227.376785:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 88 00000100:00100000:0.0:1788582227.376951:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+10:13759:x1875464002053888:12345-192.168.201.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788582227.377197:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+10:13759:x1875464002053888:12345-192.168.201.12@tcp:502:llog_process_th.0 Request processed in 250us (644us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582227.377235:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 88 00000100:00100000:0.0:1788582227.379981:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582227.383416:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002054016 00000100:00100000:3.0:1788582227.383432:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002054016 00000100:00100000:3.0:1788582227.383496:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 4 00000100:00100000:3.0:1788582227.383506:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2348:x1875464002054016:12345-192.168.201.12@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788582227.383537:0:14422:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 3db2c11a-8b82-4246-9cf9-9575f62f5233@192.168.201.12@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:3.0:1788582227.383591:0:14422:0:(genops.c:1385:class_connect()) connect: client 3db2c11a-8b82-4246-9cf9-9575f62f5233, cookie 0x2bc3aa892c3a7f73 00000004:00100000:3.0:1788582227.383623:0:14422:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1788582227.383629:0:14422:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1788582227.439928:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788582227.441688:0:14422:0:(import.c:65:import_set_state_nolock()) ffff8d0d9d85c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788582227.441785:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf375f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:2348:x1875464002054016:12345-192.168.201.12@tcp:38:mount.lustre.0 Request processed in 58277us (61809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582227.441798:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 4 00000100:00100000:2.0:1788582227.444294:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582227.444583:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002054144 00000100:00100000:1.0:1788582227.444595:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002054144 00000100:00100000:1.0:1788582227.444672:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 5 00000100:00100000:1.0:1788582227.444682:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:0:x1875464002054144:12345-192.168.201.12@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788582227.444721:0:14420:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788582227.444815:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:0:x1875464002054144:12345-192.168.201.12@tcp:41:mount.lustre.0 Request processed in 135us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582227.444822:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 5 00000100:00080000:3.0:1788582227.445266:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788582227.446508:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582227.446562:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002054272 00000100:00100000:1.0:1788582227.446570:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002054272 00000100:00100000:1.0:1788582227.446616:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 6 00000100:00100000:1.0:1788582227.446626:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:13739:x1875464002054272:12345-192.168.201.12@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788582227.446651:0:14422:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788582227.447403:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:13739:x1875464002054272:12345-192.168.201.12@tcp:41:mount.lustre.0 Request processed in 776us (894us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582227.447411:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 6 00000100:00100000:3.0:1788582227.448748:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582227.448877:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002054400 00000100:00100000:1.0:1788582227.448886:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002054400 00000100:00100000:1.0:1788582227.448929:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 7 00000100:00100000:1.0:1788582227.448937:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:13739:x1875464002054400:12345-192.168.201.12@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788582227.449089:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:13739:x1875464002054400:12345-192.168.201.12@tcp:40:mount.lustre.0 Request processed in 151us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582227.449094:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 7 00000100:00100000:2.0:1788582227.463566:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582227.463614:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582227.463674:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582227.463773:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002054528 00000100:00100000:0.0:1788582227.463784:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002054528 00000100:00100000:0.0:1788582227.463829:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002054656 00000100:00100000:0.0:1788582227.463833:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002054656 00000100:00100000:0.0:1788582227.463862:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 8 00000100:00100000:0.0:1788582227.463871:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaeab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875464002054528:12345-192.168.201.12@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788582227.463903:0:15104:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 3db2c11a-8b82-4246-9cf9-9575f62f5233@192.168.201.12@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:0.0:1788582227.463933:0:15104:0:(genops.c:1385:class_connect()) connect: client 3db2c11a-8b82-4246-9cf9-9575f62f5233, cookie 0x2bc3aa892c3a7f7a 00002000:00100000:0.0:1788582227.463945:0:15104:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3db2c11a-8b82-4246-9cf9-9575f62f5233/ffff8d0dbf4e8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788582227.463957:0:15104:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788582227.464378:0:15104:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788582227.464409:0:15104:0:(import.c:65:import_set_state_nolock()) ffff8d0dbf4ef800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788582227.464482:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaeab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:2348:x1875464002054528:12345-192.168.201.12@tcp:8:mount.lustre.0 Request processed in 610us (866us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582227.464490:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 8 00000100:00100000:0.0:1788582227.464512:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 9 00000100:00100000:0.0:1788582227.464517:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2348:x1875464002054656:12345-192.168.201.12@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788582227.464533:0:15104:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 3db2c11a-8b82-4246-9cf9-9575f62f5233@192.168.201.12@tcp t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:0.0:1788582227.464548:0:15104:0:(genops.c:1385:class_connect()) connect: client 3db2c11a-8b82-4246-9cf9-9575f62f5233, cookie 0x2bc3aa892c3a7f81 00002000:00100000:0.0:1788582227.464553:0:15104:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3db2c11a-8b82-4246-9cf9-9575f62f5233/ffff8d0dbf4ea000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788582227.464568:0:15104:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788582227.464701:0:15104:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788582227.464718:0:15104:0:(import.c:65:import_set_state_nolock()) ffff8d0dbf4e9800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788582227.464750:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaeaaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:2348:x1875464002054656:12345-192.168.201.12@tcp:8:mount.lustre.0 Request processed in 231us (1089us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582227.464756:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 9 00000100:00100000:1.0:1788582227.465256:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002054784 00000100:00100000:1.0:1788582227.465263:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002054784 00000100:00100000:1.0:1788582227.465307:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 0 00000100:00100000:1.0:1788582227.465315:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:13739:x1875464002054784:12345-192.168.201.12@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788582227.466362:0:14423:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 991us 00000004:00200000:1.0:1788582227.480182:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788582227.480325:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaea8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:13739:x1875464002054784:12345-192.168.201.12@tcp:33:mount.lustre.0 Request processed in 15004us (16764us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582227.480646:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 0 00000100:00100000:2.0:1788582227.731260:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582227.731632:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002054912 00000100:00100000:1.0:1788582227.731656:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002054912 00000100:00100000:1.0:1788582227.731758:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 8 00000100:00100000:1.0:1788582227.731770:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:13780:x1875464002054912:12345-192.168.201.12@tcp:101:mkdir.0 00010000:00010000:1.0:1788582227.731790:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582227.731816:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80400/0x2bc3aa892c3a7f88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9500 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582227.731898:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a7f8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582227.731913:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a7f8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582227.731929:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a7f8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582227.731966:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788582227.731970:0:14422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788582227.732004:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a7f8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582227.732030:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80400/0x2bc3aa892c3a7f88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9500 expref: 8 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582227.732048:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a7f8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9500 expref: 7 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582227.732057:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d9188b400) 00010000:00010000:1.0:1788582227.732060:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788582227.732063:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0c81a81c00, rc 0) 00000100:00100000:1.0:1788582227.732130:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+7:13780:x1875464002054912:12345-192.168.201.12@tcp:101:mkdir.0 Request processed in 362us (882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582227.732137:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 8 00010000:00010000:1.0:1788582228.461403:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582229.487480:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582229.487669:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020917504:0@lo:400:kworker.0 00000100:00100000:2.0:1788582229.487679:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875464020917632:0@lo:400:kworker.0 00000100:00100000:0.0:1788582229.487760:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582229.487763:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582229.487851:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020917504 00000100:00100000:0.0:1788582229.487859:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020917504 00000100:00100000:0.0:1788582229.487910:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788582229.487915:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020917632 00000100:00100000:2.0:1788582229.487920:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020917632 00000100:00100000:0.0:1788582229.487921:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875464020917504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582229.487959:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788582229.487969:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875464020917632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582229.487990:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf374380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875464020917504:12345-0@lo:400:kworker.0 Request processed in 70us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582229.487998:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788582229.488034:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d11c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875464020917632:12345-0@lo:400:kworker.0 Request processed in 66us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582229.488053:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020917504:0@lo:400:kworker.0 00000100:00100000:2.0:1788582229.488060:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788582229.488289:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875464020917632:0@lo:400:kworker.0 00000100:00100000:2.0:1788582229.488322:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020917376:0@lo:400:kworker.0 00000100:00100000:2.0:1788582229.488351:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788582229.488354:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788582229.488371:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020917376 00000100:00100000:3.0:1788582229.488376:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020917376 00000100:00100000:2.0:1788582229.488381:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875464020917888:0@lo:400:kworker.0 00000100:00100000:2.0:1788582229.488406:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582229.488414:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788582229.488423:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020917376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582229.488428:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788582229.488437:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9415e791-1a3c-4924-bcfc-d6d86718d620:3307:1875464020917248:0@lo:400:kworker.0 00000100:00100000:3.0:1788582229.488470:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020917376:12345-0@lo:400:kworker.0 Request processed in 48us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582229.488477:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582229.488484:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1788582229.488507:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788582229.488508:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875464020917760:0@lo:400:kworker.0 00000100:00100000:3.0:1788582229.488517:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788582229.488528:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020918016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788582229.488536:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582229.488563:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf377100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020917376:0@lo:400:kworker.0 00000100:00100000:3.0:1788582229.488568:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582229.488618:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020918016 00000100:00100000:2.0:1788582229.488620:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020917888 00000100:00100000:3.0:1788582229.488622:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020918016 00000100:00100000:2.0:1788582229.488625:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020917888 00000100:00100000:3.0:1788582229.488650:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788582229.488656:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875464020918016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788582229.488682:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788582229.488728:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875464020918016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582229.488735:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788582229.488766:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3309:1875464020918016:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788582229.488793:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020917760 00000100:00100000:3.0:1788582229.488796:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020917760 00000100:00100000:3.0:1788582229.493018:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788582229.493051:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875464020917760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582229.493162:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875464020917760:12345-0@lo:400:kworker.0 Request processed in 131us (4629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582229.493169:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788582229.493385:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020917248 00000100:00100000:0.0:1788582229.493395:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020917248 00000100:00100000:0.0:1788582229.493434:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788582229.493442:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+19:3307:x1875464020917248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582229.493481:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+19:3307:x1875464020917248:12345-0@lo:400:kworker.0 Request processed in 40us (5006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582229.493487:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00080000:0.0:1788582229.493544:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788582229.493586:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9415e791-1a3c-4924-bcfc-d6d86718d620:3307:1875464020917248:0@lo:400:kworker.0 00000100:00100000:0.0:1788582229.493602:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf376a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875464020917760:0@lo:400:kworker.0 00000100:00100000:2.0:1788582229.500581:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788582229.500605:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875464020917888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788582229.500735:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d10e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875464020917888:12345-0@lo:400:kworker.0 Request processed in 140us (12328us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582229.500744:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788582229.500814:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf375180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875464020917888:0@lo:400:kworker.0 00000100:00100000:3.0:1788582229.511290:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582229.511323:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002055040 00000100:00100000:3.0:1788582229.511332:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002055040 00000100:00100000:3.0:1788582229.512102:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 9 00000100:00100000:3.0:1788582229.512117:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+7:13833:x1875464002055040:12345-192.168.201.12@tcp:41:lfs.0 00000004:00000024:3.0:1788582229.512161:0:14422:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788582229.512282:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+7:13833:x1875464002055040:12345-192.168.201.12@tcp:41:lfs.0 Request processed in 169us (1002us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582229.512291:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 9 00000100:00080000:3.0:1788582229.512316:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788582229.526296:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582229.526355:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002055168 00000100:00100000:0.0:1788582229.526377:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002055168 00000100:00100000:0.0:1788582229.526437:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 5 00000100:00100000:0.0:1788582229.526449:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:13833:x1875464002055168:12345-192.168.201.12@tcp:13:lfs.0 00002000:00000024:0.0:1788582229.526488:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582229.526568:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf376a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:13833:x1875464002055168:12345-192.168.201.12@tcp:13:lfs.0 Request processed in 121us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582229.526575:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 5 00000100:00080000:0.0:1788582229.526596:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788582229.530639:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582229.530750:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002055296 00000100:00100000:0.0:1788582229.530761:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002055296 00000100:00100000:0.0:1788582229.530845:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 6 00000100:00080000:3.0:1788582229.530854:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788582229.530858:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:13833:x1875464002055296:12345-192.168.201.12@tcp:13:lfs.0 00002000:00000024:0.0:1788582229.530888:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582229.530981:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:13833:x1875464002055296:12345-192.168.201.12@tcp:13:lfs.0 Request processed in 118us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582229.530989:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 6 00000001:00100000:3.0:1788582229.574584:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3db2c11a-8b82-4246-9cf9-9575f62f5233 00000001:00080000:3.0:1788582229.574621:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:0.0:1788582229.700238:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582229.700332:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002055424 00000100:00100000:3.0:1788582229.700343:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002055424 00000100:00100000:3.0:1788582229.700398:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 90 00000100:00100000:3.0:1788582229.700408:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+10:13864:x1875464002055424:12345-192.168.201.12@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788582229.700426:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582229.700445:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8138fa00/0x2bc3aa892c3a7f96 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9507 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582229.700473:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8138fa00/0x2bc3aa892c3a7f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9507 expref: 11 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582229.700485:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8138fa00/0x2bc3aa892c3a7f96 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9507 expref: 11 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582229.700494:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8138fa00, rc 0) 00000100:00100000:3.0:1788582229.700555:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+11:13864:x1875464002055424:12345-192.168.201.12@tcp:101:mount.lustre.0 Request processed in 148us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582229.700563:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 90 00000100:00100000:3.0:1788582229.707409:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582229.708923:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002055552 00000100:00100000:0.0:1788582229.708940:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002055552 00000100:00100000:0.0:1788582229.709020:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 91 00000100:00100000:0.0:1788582229.709032:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c32afc4-6db4-4783-a556-081dabcc0c13+11:13864:x1875464002055552:12345-192.168.201.12@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788582229.709491:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c32afc4-6db4-4783-a556-081dabcc0c13+11:13864:x1875464002055552:12345-192.168.201.12@tcp:501:mount.lustre.0 Request processed in 459us (2091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582229.709500:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 91 00000100:00100000:2.0:1788582229.734281:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582229.734789:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002055680 00000100:00100000:0.0:1788582229.734824:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002055680 00000100:00100000:0.0:1788582229.734884:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 92 00000100:00100000:0.0:1788582229.734895:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+11:13864:x1875464002055680:12345-192.168.201.12@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788582229.735183:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+11:13864:x1875464002055680:12345-192.168.201.12@tcp:503:mount.lustre.0 Request processed in 288us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582229.735192:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 92 00000100:00100000:3.0:1788582229.738716:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582229.738979:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002055808 00000100:00100000:0.0:1788582229.738990:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002055808 00000100:00100000:0.0:1788582229.739053:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 93 00000100:00100000:0.0:1788582229.739064:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c32afc4-6db4-4783-a556-081dabcc0c13+11:13871:x1875464002055808:12345-192.168.201.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788582229.739959:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c32afc4-6db4-4783-a556-081dabcc0c13+11:13871:x1875464002055808:12345-192.168.201.12@tcp:502:llog_process_th.0 Request processed in 892us (1259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582229.739968:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 93 00000100:00100000:1.0:1788582229.776649:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582229.776793:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002055936 00000100:00100000:0.0:1788582229.776804:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002055936 00000100:00100000:0.0:1788582229.776859:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 94 00000100:00100000:0.0:1788582229.776869:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+11:13871:x1875464002055936:12345-192.168.201.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788582229.777538:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+11:13871:x1875464002055936:12345-192.168.201.12@tcp:502:llog_process_th.0 Request processed in 668us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582229.777546:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 94 00000100:00100000:2.0:1788582229.784674:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582229.785301:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002056064 00000100:00100000:0.0:1788582229.785314:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002056064 00000100:00100000:0.0:1788582229.785369:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 95 00000100:00100000:0.0:1788582229.785380:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c32afc4-6db4-4783-a556-081dabcc0c13+11:13864:x1875464002056064:12345-192.168.201.12@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788582229.785400:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582229.785436:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d9d8e3600/0x2bc3aa892c3a7f9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9531 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582229.785470:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d9d8e3600/0x2bc3aa892c3a7f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9531 expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582229.785483:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d9d8e3600/0x2bc3aa892c3a7f9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9531 expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582229.785494:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d9d8e3600, rc 0) 00000100:00100000:0.0:1788582229.785574:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c32afc4-6db4-4783-a556-081dabcc0c13+12:13864:x1875464002056064:12345-192.168.201.12@tcp:101:mount.lustre.0 Request processed in 195us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582229.785580:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 95 00000100:00100000:3.0:1788582229.795934:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582229.796714:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002056192 00000100:00100000:0.0:1788582229.796726:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002056192 00000100:00100000:0.0:1788582229.796788:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 96 00000100:00100000:0.0:1788582229.796797:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+12:13864:x1875464002056192:12345-192.168.201.12@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788582229.796826:0:14413:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788582229.796861:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788582229.796865:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788582229.796868:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788582229.796870:0:14413:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1788582229.799035:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+12:13864:x1875464002056192:12345-192.168.201.12@tcp:256:mount.lustre.0 Request processed in 2227us (3102us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582229.799048:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 96 00000100:00100000:2.0:1788582229.803498:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582229.803596:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002056320 00000100:00100000:3.0:1788582229.803607:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002056320 00000100:00100000:3.0:1788582229.803667:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 97 00000100:00100000:3.0:1788582229.803893:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+12:13864:x1875464002056320:12345-192.168.201.12@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788582229.803928:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582229.803947:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8138e000/0x2bc3aa892c3a7fa4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9538 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582229.803976:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8138e000/0x2bc3aa892c3a7fa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9538 expref: 13 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582229.803987:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8138e000/0x2bc3aa892c3a7fa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9538 expref: 13 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582229.803996:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8138e000, rc 0) 00000100:00100000:3.0:1788582229.804557:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+13:13864:x1875464002056320:12345-192.168.201.12@tcp:101:mount.lustre.0 Request processed in 666us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582229.804564:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 97 00000100:00100000:3.0:1788582229.809554:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582229.810148:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002056448 00000100:00100000:0.0:1788582229.810159:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002056448 00000100:00100000:0.0:1788582229.810317:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 98 00000100:00100000:0.0:1788582229.810330:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+13:13864:x1875464002056448:12345-192.168.201.12@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788582229.810739:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+13:13864:x1875464002056448:12345-192.168.201.12@tcp:501:mount.lustre.0 Request processed in 409us (1194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582229.810747:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 98 00000100:00100000:1.0:1788582229.820611:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582229.820909:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002056576 00000100:00100000:2.0:1788582229.820937:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002056576 00000100:00100000:2.0:1788582229.821671:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 99 00000100:00100000:2.0:1788582229.821686:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+13:13864:x1875464002056576:12345-192.168.201.12@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788582229.821978:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+13:13864:x1875464002056576:12345-192.168.201.12@tcp:503:mount.lustre.0 Request processed in 295us (1378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582229.821987:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 99 00000100:00100000:3.0:1788582229.824670:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582229.824876:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002056704 00000100:00100000:1.0:1788582229.824887:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002056704 00000100:00100000:1.0:1788582229.825549:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 100 00000100:00100000:1.0:1788582229.825561:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c32afc4-6db4-4783-a556-081dabcc0c13+13:13878:x1875464002056704:12345-192.168.201.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788582229.825882:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c32afc4-6db4-4783-a556-081dabcc0c13+13:13878:x1875464002056704:12345-192.168.201.12@tcp:502:llog_process_th.0 Request processed in 322us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582229.825891:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 100 00000100:00100000:3.0:1788582229.828658:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582229.828933:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002056832 00000100:00100000:2.0:1788582229.828943:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002056832 00000100:00100000:2.0:1788582229.829001:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 101 00000100:00100000:2.0:1788582229.829011:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+13:13878:x1875464002056832:12345-192.168.201.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788582229.829469:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+13:13878:x1875464002056832:12345-192.168.201.12@tcp:502:llog_process_th.0 Request processed in 458us (819us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582229.829479:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 101 00000100:00100000:3.0:1788582229.837009:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582229.837102:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582229.837252:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002056960 00000100:00100000:0.0:1788582229.837262:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002056960 00000100:00100000:0.0:1788582229.837306:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002057344 00000100:00100000:0.0:1788582229.837309:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002057344 00000100:00100000:0.0:1788582229.837337:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 14 00000100:00100000:0.0:1788582229.837348:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+7:2349:x1875464002057344:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582229.837428:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+7:2349:x1875464002057344:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 80us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582229.837435:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 14 00000100:00100000:0.0:1788582229.837455:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 10 00000100:00100000:0.0:1788582229.837462:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2348:x1875464002056960:12345-192.168.201.12@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788582229.837485:0:14420:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 16af31e5-f4cf-4f02-9db7-6ba114cc9b47@192.168.201.12@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:0.0:1788582229.837524:0:14420:0:(genops.c:1385:class_connect()) connect: client 16af31e5-f4cf-4f02-9db7-6ba114cc9b47, cookie 0x2bc3aa892c3a7fab 00000004:00100000:0.0:1788582229.837555:0:14420:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788582229.837681:0:14420:0:(import.c:65:import_set_state_nolock()) ffff8d0dbf4ed000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788582229.837726:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+6:2348:x1875464002056960:12345-192.168.201.12@tcp:38:mount.lustre.0 Request processed in 264us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582229.837733:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 10 00000100:00100000:3.0:1788582229.842361:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582229.842399:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582229.842508:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002057600 00000100:00100000:0.0:1788582229.842517:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002057600 00000100:00100000:0.0:1788582229.842571:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002057472 00000100:00100000:0.0:1788582229.842574:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002057472 00000100:00100000:0.0:1788582229.843984:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 4 00000100:00100000:0.0:1788582229.844019:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+5:2349:x1875464002057600:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582229.844105:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+5:2349:x1875464002057600:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 94us (1754us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582229.844124:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 4 00000100:00100000:0.0:1788582229.844160:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 5 00000100:00100000:0.0:1788582229.844168:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:2349:x1875464002057472:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582229.844192:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:2349:x1875464002057472:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 25us (1793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582229.844198:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 5 00000100:00100000:1.0:1788582229.848256:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582229.848335:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582229.848418:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002057088 00000100:00100000:3.0:1788582229.848430:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002057088 00000100:00100000:3.0:1788582229.848507:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002057216 00000100:00100000:3.0:1788582229.848511:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002057216 00000100:00100000:3.0:1788582229.848659:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 11 00000100:00100000:3.0:1788582229.848671:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+7:0:x1875464002057088:12345-192.168.201.12@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788582229.848712:0:14421:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788582229.848800:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+7:0:x1875464002057088:12345-192.168.201.12@tcp:41:mount.lustre.0 Request processed in 131us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582229.848808:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 11 00000100:00080000:1.0:1788582229.848898:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788582229.848914:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 12 00000100:00100000:3.0:1788582229.848933:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+6:13864:x1875464002057216:12345-192.168.201.12@tcp:41:mount.lustre.0 00000004:00000024:3.0:1788582229.848945:0:14421:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788582229.848984:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+6:13864:x1875464002057216:12345-192.168.201.12@tcp:41:mount.lustre.0 Request processed in 52us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582229.848991:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 12 00000100:00100000:1.0:1788582229.855704:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582229.855763:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002057728 00000100:00100000:0.0:1788582229.855832:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002057728 00000100:00100000:0.0:1788582229.855887:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 13 00000100:00100000:0.0:1788582229.855895:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+6:13864:x1875464002057728:12345-192.168.201.12@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788582229.855969:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+6:13864:x1875464002057728:12345-192.168.201.12@tcp:40:mount.lustre.0 Request processed in 75us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582229.855975:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 13 00000100:00100000:1.0:1788582229.858606:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582229.858727:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002057856 00000100:00100000:0.0:1788582229.858739:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002057856 00000100:00100000:0.0:1788582229.858788:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 10 00000100:00100000:0.0:1788582229.858806:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875464002057856:12345-192.168.201.12@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788582229.858840:0:15106:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 16af31e5-f4cf-4f02-9db7-6ba114cc9b47@192.168.201.12@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:0.0:1788582229.858874:0:15106:0:(genops.c:1385:class_connect()) connect: client 16af31e5-f4cf-4f02-9db7-6ba114cc9b47, cookie 0x2bc3aa892c3a7fb2 00002000:00100000:0.0:1788582229.858887:0:15106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 16af31e5-f4cf-4f02-9db7-6ba114cc9b47/ffff8d0dbf4eb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788582229.858899:0:15106:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788582229.858976:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00002000:00080000:0.0:1788582229.859041:0:15106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:2.0:1788582229.859043:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002058112 00000100:00100000:2.0:1788582229.859049:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002058112 00000100:00100000:1.0:1788582229.859074:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00080000:0.0:1788582229.859077:0:15106:0:(import.c:65:import_set_state_nolock()) ffff8d0dbf4eb800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788582229.859111:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1788582229.859120:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788582229.859146:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+6:2348:x1875464002057856:12345-192.168.201.12@tcp:8:mount.lustre.0 Request processed in 348us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582229.859154:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 10 00000100:00100000:2.0:1788582229.859160:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 1 00000100:00100000:2.0:1788582229.859172:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+6:13864:x1875464002058112:12345-192.168.201.12@tcp:33:mount.lustre.0 00000100:00100000:0.0:1788582229.859177:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002057984 00000100:00100000:0.0:1788582229.859183:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002057984 00000100:00100000:0.0:1788582229.859233:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 11 00000100:00100000:0.0:1788582229.859239:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2348:x1875464002057984:12345-192.168.201.12@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788582229.859257:0:15106:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 16af31e5-f4cf-4f02-9db7-6ba114cc9b47@192.168.201.12@tcp t0 exp 0000000000000000 cur 448 last 0 00000004:00200000:2.0:1788582229.859271:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000020:00000080:0.0:1788582229.859278:0:15106:0:(genops.c:1385:class_connect()) connect: client 16af31e5-f4cf-4f02-9db7-6ba114cc9b47, cookie 0x2bc3aa892c3a7fb9 00002000:00100000:0.0:1788582229.859285:0:15106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 16af31e5-f4cf-4f02-9db7-6ba114cc9b47/ffff8d0dbf4ed800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113968 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788582229.859292:0:15106:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788582229.859336:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+6:13864:x1875464002058112:12345-192.168.201.12@tcp:33:mount.lustre.0 Request processed in 166us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582229.859344:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 1 00002000:00080000:0.0:1788582229.859477:0:15106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788582229.859492:0:15106:0:(import.c:65:import_set_state_nolock()) ffff8d0dbf4ec800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788582229.859519:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+6:2348:x1875464002057984:12345-192.168.201.12@tcp:8:mount.lustre.0 Request processed in 278us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582229.859527:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 11 00000100:00100000:1.0:1788582230.002040:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582230.002104:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002058240 00000100:00100000:2.0:1788582230.002115:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002058240 00000100:00100000:2.0:1788582230.002177:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 14 00000100:00100000:2.0:1788582230.002189:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+6:13899:x1875464002058240:12345-192.168.201.12@tcp:101:mkdir.0 00010000:00010000:2.0:1788582230.002247:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582230.002268:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05600/0x2bc3aa892c3a7fc0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9562 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582230.002321:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7fc7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582230.002331:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582230.002342:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582230.002369:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788582230.002372:0:14422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788582230.002387:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7fc7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582230.002405:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05600/0x2bc3aa892c3a7fc0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9562 expref: 8 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582230.002598:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9562 expref: 7 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582230.002616:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d9188b400) 00010000:00010000:2.0:1788582230.002618:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788582230.002620:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05400, rc 0) 00000100:00100000:2.0:1788582230.002685:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+7:13899:x1875464002058240:12345-192.168.201.12@tcp:101:mkdir.0 Request processed in 499us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582230.002713:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 14 00010000:00010000:1.0:1788582230.509326:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788582230.557956:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 16af31e5-f4cf-4f02-9db7-6ba114cc9b47 00000001:00100000:3.0:1788582230.557972:0:6716:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3db2c11a-8b82-4246-9cf9-9575f62f5233 00010000:00010000:1.0:1788582231.533387:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582231.533531:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788582231.533552:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020918144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788582231.533617:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582231.533760:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020918144 00000100:00100000:0.0:1788582231.533771:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020918144 00000100:00080000:1.0:1788582231.533908:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788582231.533958:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788582231.533969:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020918144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788582231.534002:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582231.534465:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d11180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020918144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 497us (846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582231.534474:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788582231.538917:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf376d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020918144:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1788582232.323716:0:16380:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1788582232.558176:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788582232.579776:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 16af31e5-f4cf-4f02-9db7-6ba114cc9b47 00000001:00100000:2.0:1788582232.579883:0:5866:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3db2c11a-8b82-4246-9cf9-9575f62f5233 00010000:00010000:1.0:1788582233.585464:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788582233.968232:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788582234.607301:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788582234.611489:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020918272:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788582234.611567:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582234.611711:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020918272 00000100:00100000:3.0:1788582234.611719:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020918272 00000100:00100000:3.0:1788582234.611777:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788582234.611787:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020918272:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788582234.612353:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9415e791-1a3c-4924-bcfc-d6d86718d620:3307:1875464020918400:0@lo:400:kworker.0 00000100:00100000:0.0:1788582234.612396:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582234.612426:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875464020918912:0@lo:400:kworker.0 00000100:00100000:0.0:1788582234.612452:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582234.612472:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788582234.612477:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875464020918784:0@lo:400:kworker.0 00000100:00100000:0.0:1788582234.612497:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582234.612526:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020918528:0@lo:400:kworker.0 00000100:00100000:0.0:1788582234.612548:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582234.612566:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788582234.612571:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020918656:0@lo:400:kworker.0 00000100:00100000:0.0:1788582234.612593:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582234.612631:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020918400 00000100:00100000:0.0:1788582234.612636:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020918400 00000100:00100000:0.0:1788582234.612672:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788582234.612679:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+19:3307:x1875464020918400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582234.612725:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+19:3307:x1875464020918400:12345-0@lo:400:kworker.0 Request processed in 47us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582234.612732:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788582234.612801:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020918912 00000100:00100000:0.0:1788582234.612805:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020918912 00000100:00100000:0.0:1788582234.612828:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020918784 00000100:00100000:0.0:1788582234.612831:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020918784 00000100:00100000:0.0:1788582234.612843:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020918656 00000100:00100000:0.0:1788582234.612845:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020918656 00000100:00100000:0.0:1788582234.612856:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788582234.612862:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875464020918912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582234.612900:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf376d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1875464020918912:12345-0@lo:400:kworker.0 Request processed in 38us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582234.612907:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788582234.612918:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788582234.612924:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875464020918784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582234.612948:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf375180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1875464020918784:12345-0@lo:400:kworker.0 Request processed in 25us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582234.612954:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788582234.612964:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788582234.612969:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020918656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582234.612996:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf374e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875464020918656:12345-0@lo:400:kworker.0 Request processed in 28us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582234.613002:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788582234.613020:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020918528 00000100:00100000:0.0:1788582234.613024:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020918528 00000100:00100000:0.0:1788582234.613054:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788582234.613060:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020918528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582234.613084:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf377100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020918528:12345-0@lo:400:kworker.0 Request processed in 25us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582234.613089:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788582234.613120:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3307:1875464020918784:0@lo:400:kworker.0 00000100:00100000:0.0:1788582234.613128:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf377b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:9415e791-1a3c-4924-bcfc-d6d86718d620:3307:1875464020918400:0@lo:400:kworker.0 00000100:00100000:0.0:1788582234.613134:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf377800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3307:1875464020918912:0@lo:400:kworker.0 00000100:00100000:0.0:1788582234.613160:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875464020918656:0@lo:400:kworker.0 00000100:00100000:0.0:1788582234.613178:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020918528:0@lo:400:kworker.0 00002000:00000024:3.0:1788582234.613306:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788582234.613360:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020918272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1574us (1794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582234.613367:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:3.0:1788582234.613389:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788582234.613394:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788582234.613396:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788582234.615666:0:3306:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788582234.615698:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020918272:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788582234.716256:0:7648:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 16af31e5-f4cf-4f02-9db7-6ba114cc9b47 00000100:00100000:3.0:1788582234.975901:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582234.975971:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582234.976010:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582234.976048:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582234.976071:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582234.976090:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582234.976113:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582234.976142:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002058624 00000100:00100000:3.0:1788582234.976152:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002058624 00000100:00100000:3.0:1788582234.976234:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002059136 00000100:00100000:3.0:1788582234.976238:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002059136 00000100:00100000:3.0:1788582234.977049:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002058752 00000100:00100000:3.0:1788582234.977058:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002058752 00000100:00100000:3.0:1788582234.977086:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002059008 00000100:00100000:3.0:1788582234.977090:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002059008 00000100:00100000:3.0:1788582234.977108:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 7 00000100:00100000:3.0:1788582234.977118:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+5:2351:x1875464002058624:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582234.977222:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+5:2351:x1875464002058624:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 84us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582234.977231:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 7 00000100:00100000:3.0:1788582234.977248:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 8 00000100:00100000:3.0:1788582234.977254:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+5:2351:x1875464002059136:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582234.977348:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 9 00000100:00100000:0.0:1788582234.977359:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+5:2351:x1875464002058752:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582234.977389:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf433480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+5:2351:x1875464002058752:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 34us (1298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582234.977394:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 9 00000100:00100000:0.0:1788582234.977408:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 10 00000100:00100000:0.0:1788582234.977414:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+5:2351:x1875464002059008:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582234.977437:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf430a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+5:2351:x1875464002059008:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 24us (1324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582234.977443:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 10 00000100:00100000:1.0:1788582234.978329:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002058368 00000100:00100000:1.0:1788582234.978338:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002058368 00000100:00100000:1.0:1788582234.978395:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 103 00000100:00100000:1.0:1788582234.978403:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c32afc4-6db4-4783-a556-081dabcc0c13+13:2351:x1875464002058368:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582234.978461:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c32afc4-6db4-4783-a556-081dabcc0c13+13:2351:x1875464002058368:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 59us (2569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582234.978469:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 103 00000100:00100000:1.0:1788582234.978543:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002058880 00000100:00100000:1.0:1788582234.978548:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002058880 00000100:00100000:1.0:1788582234.978577:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002058496 00000100:00100000:1.0:1788582234.978580:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002058496 00000100:00100000:1.0:1788582234.978597:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 18 00000100:00100000:1.0:1788582234.978603:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+6:2351:x1875464002058880:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582234.978645:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+6:2351:x1875464002058880:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 42us (2634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582234.978651:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 18 00000100:00100000:1.0:1788582234.978662:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 19 00000100:00100000:1.0:1788582234.978668:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:2351:x1875464002058496:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582234.978688:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf433100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:2351:x1875464002058496:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 21us (2617us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582234.978693:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 19 00000100:00080000:1.0:1788582234.978734:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788582234.978738:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788582234.978740:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788582234.980773:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf432a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+5:2351:x1875464002059136:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 3509us (4715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582234.980788:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 8 00000020:00000080:2.0:1788582235.515396:0:16531:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd7a555660 20000000:00000080:2.0:1788582235.515475:0:16531:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d0c81ba1400 uarg=0000000000000000 20000000:01000000:2.0:1788582235.515517:0:16531:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788582235.515522:0:16531:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788582235.515527:0:16531:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788582235.516624:0:16532:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:2.0:1788582235.516790:0:16531:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788582235.535493:0:16531:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788582235.535696:0:16531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d0d8138f600/0x2bc3aa892c3a7fce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.535718:0:16531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0dbbe04400/0x2bc3aa892c3a7cc5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7cbe expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.535727:0:16531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d88e27e00/0x2bc3aa892c3a7d12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7d0b expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.535746:0:16531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0dbbe04600/0x2bc3aa892c3a7e4d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7e46 expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.535756:0:16531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a7f6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c94d6 expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.535764:0:16531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d0d8138e000/0x2bc3aa892c3a7fa4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9538 expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.535772:0:16531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d0d8138f600/0x2bc3aa892c3a7fce lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.535819:0:16531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d8138e000/0x2bc3aa892c3a7fa4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9538 expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.535837:0:16531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d0d8138e000/0x2bc3aa892c3a7fa4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9538 expref: 12 pid: 14414 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582235.535854:0:16531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf431880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16531:1875464020919040:192.168.201.12@tcp:104: 00010000:00010000:3.0:1788582235.535983:0:16531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a7f6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c94d6 expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.536005:0:16531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a7f6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c94d6 expref: 12 pid: 14415 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582235.536015:0:16531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf430700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16531:1875464020919168:192.168.201.12@tcp:104: 00010000:00010000:3.0:1788582235.536694:0:16531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0dbbe04600/0x2bc3aa892c3a7e4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a7e46 expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.536715:0:16531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d0dbbe04600/0x2bc3aa892c3a7e4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7e46 expref: 18 pid: 14414 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582235.536724:0:16531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf430e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16531:1875464020919296:0@lo:104: 00000100:00100000:3.0:1788582235.536761:0:16531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788582235.536790:0:16531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0d88e27e00/0x2bc3aa892c3a7d12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a7d0b expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.536799:0:16531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d0d88e27e00/0x2bc3aa892c3a7d12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7d0b expref: 18 pid: 14415 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582235.536807:0:16531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf431180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16531:1875464020919424:0@lo:104: 00000100:00100000:3.0:1788582235.536825:0:16531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582235.536856:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020919296 00000100:00100000:3.0:1788582235.536863:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020919296 00000100:00100000:3.0:1788582235.536899:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020919424 00000100:00100000:3.0:1788582235.536903:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020919424 00000100:00100000:3.0:1788582235.536920:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788582235.536928:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf431f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9415e791-1a3c-4924-bcfc-d6d86718d620+4:16531:x1875464020919296:12345-0@lo:104: 00010000:00010000:3.0:1788582235.536939:0:14404:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27a00/0x2bc3aa892c3a7e46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a7e4d expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.537583:0:14404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788582235.537592:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf431f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9415e791-1a3c-4924-bcfc-d6d86718d620+4:16531:x1875464020919296:12345-0@lo:104: Request processed in 663us (829us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582235.537610:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788582235.537632:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788582235.537639:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf433800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9415e791-1a3c-4924-bcfc-d6d86718d620+3:16531:x1875464020919424:12345-0@lo:104: 00010000:00010000:3.0:1788582235.537656:0:14404:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0da7088200/0x2bc3aa892c3a7d0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a7d12 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582235.539674:0:16531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d0dbbe04400/0x2bc3aa892c3a7cc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x2bc3aa892c3a7cbe expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582235.539688:0:16531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d0dbbe04400/0x2bc3aa892c3a7cc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7cbe expref: 18 pid: 14414 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582235.539703:0:16531:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d12300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16531:1875464020919552:0@lo:104: 00000100:00100000:2.0:1788582235.539762:0:16531:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582235.539809:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788582235.539821:0:14403:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788582235.539826:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:2.0:1788582235.539849:0:16531:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8722f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788582235.539874:0:16531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf430e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16531:1875464020919296:0@lo:104: 00000100:00100000:2.0:1788582235.539881:0:16531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf431180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16531:1875464020919424:0@lo:104: 00010000:00010000:0.0:1788582235.540618:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788582235.540634:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27a00/0x2bc3aa892c3a7e46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a7e4d expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582235.540644:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e27a00 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:0.0:1788582235.540651:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27a00/0x2bc3aa892c3a7e46 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a7e4d expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582235.540662:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27a00/0x2bc3aa892c3a7e46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a7e4d expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788582235.540689:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27a00/0x2bc3aa892c3a7e46 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a7e4d expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788582235.540695:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788582235.540772:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27a00/0x2bc3aa892c3a7e46 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a7e4d expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582235.540779:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788582235.540798:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27a00/0x2bc3aa892c3a7e46 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a7e4d expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582235.540805:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d88e27a00/0x2bc3aa892c3a7e46 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a7e4d expref: -99 pid: 15819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582235.540817:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788582235.540820:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0da7088200/0x2bc3aa892c3a7d0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a7d12 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582235.540826:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0da7088200 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:0.0:1788582235.540828:0:14408:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0da7088200/0x2bc3aa892c3a7d0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a7d12 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582235.540835:0:14408:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0da7088200/0x2bc3aa892c3a7d0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a7d12 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788582235.540842:0:14408:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0da7088200/0x2bc3aa892c3a7d0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a7d12 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788582235.540846:0:14408:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788582235.540866:0:14404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1788582235.540878:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf433800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9415e791-1a3c-4924-bcfc-d6d86718d620+3:16531:x1875464020919424:12345-0@lo:104: Request processed in 3236us (4048us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582235.540889:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1788582235.540891:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788582235.540918:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020919552 00000100:00100000:3.0:1788582235.540926:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020919552 00000100:00100000:3.0:1788582235.540957:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788582235.540965:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac128850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9415e791-1a3c-4924-bcfc-d6d86718d620+3:16531:x1875464020919552:12345-0@lo:104: 00010000:00010000:3.0:1788582235.540974:0:14404:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26a00/0x2bc3aa892c3a7cbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a7cc5 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582235.541155:0:14408:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0da7088200/0x2bc3aa892c3a7d0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a7d12 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582235.541162:0:14408:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788582235.541168:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0da7088200/0x2bc3aa892c3a7d0b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a7d12 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582235.541174:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0da7088200/0x2bc3aa892c3a7d0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a7d12 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582235.541183:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582235.541185:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788582235.541186:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788582235.541262:0:14404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788582235.541268:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac128850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:9415e791-1a3c-4924-bcfc-d6d86718d620+3:16531:x1875464020919552:12345-0@lo:104: Request processed in 303us (1506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582235.541273:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788582235.541303:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9415e791-1a3c-4924-bcfc-d6d86718d620:3308:1875464020919680:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788582235.541337:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582235.541368:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788582235.541373:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9415e791-1a3c-4924-bcfc-d6d86718d620:3308:1875464020919808:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788582235.541389:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788582235.541523:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788582235.541529:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26a00/0x2bc3aa892c3a7cbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x2bc3aa892c3a7cc5 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582235.541535:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d88e26a00 already unused, calling callback (ffffffffc1d07c20) 10000000:00010000:1.0:1788582235.541538:0:14409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26a00/0x2bc3aa892c3a7cbe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x2bc3aa892c3a7cc5 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582235.541545:0:14409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26a00/0x2bc3aa892c3a7cbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x2bc3aa892c3a7cc5 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788582235.541551:0:14409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26a00/0x2bc3aa892c3a7cbe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x2bc3aa892c3a7cc5 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788582235.541556:0:14409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788582235.541728:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582235.541916:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582235.541935:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020919680 00000100:00100000:3.0:1788582235.541939:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020919680 00010000:00010000:3.0:1788582235.541961:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0dbbe04600/0x2bc3aa892c3a7e4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7e46 expref: 19 pid: 14414 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582235.541975:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020919808 00000100:00100000:3.0:1788582235.541985:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020919808 00010000:00010000:3.0:1788582235.541996:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d88e27e00/0x2bc3aa892c3a7d12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7d0b expref: 20 pid: 14415 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582235.542018:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002059264 00000100:00100000:3.0:1788582235.542021:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002059264 00010000:00010000:3.0:1788582235.542252:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d8138e000/0x2bc3aa892c3a7fa4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9538 expref: 13 pid: 14414 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582235.542265:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002059392 00000100:00100000:3.0:1788582235.542268:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002059392 00010000:00010000:3.0:1788582235.542278:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a7f6c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c94d6 expref: 14 pid: 14415 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582235.542289:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788582235.542296:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf377800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9415e791-1a3c-4924-bcfc-d6d86718d620+20:3308:x1875464020919680:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788582235.542306:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582235.542311:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0dbbe04600/0x2bc3aa892c3a7e4d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7e46 expref: 20 pid: 14414 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.542320:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0dbbe04600/0x2bc3aa892c3a7e4d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7e46 expref: 20 pid: 14414 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.542334:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0dbbe04600/0x2bc3aa892c3a7e4d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a7e46 expref: 20 pid: 14414 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.542346:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582235.542383:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf377800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9415e791-1a3c-4924-bcfc-d6d86718d620+19:3308:x1875464020919680:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582235.542390:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788582235.542883:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788582235.542895:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf377b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9415e791-1a3c-4924-bcfc-d6d86718d620+18:3308:x1875464020919808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788582235.542913:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582235.542919:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d88e27e00/0x2bc3aa892c3a7d12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7d0b expref: 18 pid: 14415 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.542927:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d88e27e00/0x2bc3aa892c3a7d12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7d0b expref: 18 pid: 14415 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.542938:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d88e27e00/0x2bc3aa892c3a7d12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a7d0b expref: 18 pid: 14415 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.542946:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582235.542969:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf377b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9415e791-1a3c-4924-bcfc-d6d86718d620+17:3308:x1875464020919808:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (1579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582235.542975:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788582235.543359:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 6 00000100:00100000:3.0:1788582235.543368:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaee2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c32afc4-6db4-4783-a556-081dabcc0c13+14:2350:x1875464002059264:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582235.543378:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582235.543384:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d8138e000/0x2bc3aa892c3a7fa4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9538 expref: 14 pid: 14414 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.543396:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d8138e000/0x2bc3aa892c3a7fa4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9538 expref: 14 pid: 14414 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.543476:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582235.543522:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaee2050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c32afc4-6db4-4783-a556-081dabcc0c13+14:2350:x1875464002059264:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 155us (1795us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582235.543529:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 6 00000100:00100000:3.0:1788582235.543581:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 7 00000100:00100000:3.0:1788582235.543608:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf431f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c32afc4-6db4-4783-a556-081dabcc0c13+13:2349:x1875464002059392:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582235.543939:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582235.543945:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a7f6c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c94d6 expref: 13 pid: 14415 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.543955:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a7f6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c94d6 expref: 13 pid: 14415 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.543966:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582235.544124:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf431f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7c32afc4-6db4-4783-a556-081dabcc0c13+13:2349:x1875464002059392:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 527us (2208us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582235.544131:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 7 00000100:00100000:3.0:1788582235.544174:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9415e791-1a3c-4924-bcfc-d6d86718d620:3308:1875464020919808:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788582235.544185:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf377480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9415e791-1a3c-4924-bcfc-d6d86718d620:3308:1875464020919680:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788582235.544412:0:16531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8138e000/0x2bc3aa892c3a7fa4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9538 expref: 12 pid: 14414 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582235.544498:0:16531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf431880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16531:1875464020919040:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582235.544513:0:16531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a7f6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c94d6 expref: 11 pid: 14415 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582235.544521:0:16531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf430700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16531:1875464020919168:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582235.544531:0:16531:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d12300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16531:1875464020919552:0@lo:104: 00010000:00010000:2.0:1788582235.544552:0:16531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d0d8138f600/0x2bc3aa892c3a7fce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582235.544668:0:14409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26a00/0x2bc3aa892c3a7cbe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a7cc5 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582235.544674:0:14409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788582235.544706:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26a00/0x2bc3aa892c3a7cbe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a7cc5 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582235.544713:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.112@tcp lock: ffff8d0d88e26a00/0x2bc3aa892c3a7cbe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x2bc3aa892c3a7cc5 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582235.544739:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582235.544741:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582235.544744:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788582235.544786:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9415e791-1a3c-4924-bcfc-d6d86718d620:3306:1875464020919936:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788582235.544828:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582235.545409:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020919936 00000100:00100000:1.0:1788582235.545417:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020919936 00010000:00010000:3.0:1788582235.545530:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d0dbbe04400/0x2bc3aa892c3a7cc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7cbe expref: 17 pid: 14414 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582235.545554:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788582235.545559:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf374700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9415e791-1a3c-4924-bcfc-d6d86718d620+17:3306:x1875464020919936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788582235.545567:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582235.545570:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d0dbbe04400/0x2bc3aa892c3a7cc5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7cbe expref: 17 pid: 14414 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.545578:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d0dbbe04400/0x2bc3aa892c3a7cc5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x2bc3aa892c3a7cbe expref: 17 pid: 14414 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.545587:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0dbbe04400/0x2bc3aa892c3a7cc5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x2bc3aa892c3a7cbe expref: 17 pid: 14414 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.545616:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d0d8138f600/0x2bc3aa892c3a7fce lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.545628:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8138f600/0x2bc3aa892c3a7fce lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.545642:0:14405:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0d8138f600/0x2bc3aa892c3a7fce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.545650:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d0d8138f600/0x2bc3aa892c3a7fce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.545657:0:14405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d0d8138f600/0x2bc3aa892c3a7fce lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.545663:0:14405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d0d8138f600/0x2bc3aa892c3a7fce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.545668:0:14405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8138f600 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:3.0:1788582235.545671:0:14405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d0d8138f600/0x2bc3aa892c3a7fce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.545676:0:14405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d0d8138f600/0x2bc3aa892c3a7fce lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.545690:0:14405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d0d8138f600/0x2bc3aa892c3a7fce lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582235.545698:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788582235.545760:0:16531:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d0d8138f600/0x2bc3aa892c3a7fce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582235.545799:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf374700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9415e791-1a3c-4924-bcfc-d6d86718d620+16:3306:x1875464020919936:12345-0@lo:103:ldlm_bl.0 Request processed in 238us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582235.545812:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788582235.545867:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:9415e791-1a3c-4924-bcfc-d6d86718d620:3306:1875464020919936:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788582235.545890:0:16531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d0d8138f600/0x2bc3aa892c3a7fce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582235.545897:0:16531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d0d8138f600/0x2bc3aa892c3a7fce lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582235.632254:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788582236.590169:0:14417:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788582236.590176:0:14417:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0d9d88a000 from 10 10000000:01000000:3.0:1788582236.590181:0:14417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788582236.590623:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fe00/0x2bc3aa892c3a7fd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582236.590637:0:14417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fe00/0x2bc3aa892c3a7fd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582236.590649:0:14417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fe00/0x2bc3aa892c3a7fd5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582236.590673:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf433800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020920064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788582236.590733:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582236.590778:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8722f600 going to sleep for 11 seconds 00000100:00100000:0.0:1788582236.592489:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020920064 00000100:00100000:0.0:1788582236.592512:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020920064 00000100:00100000:0.0:1788582236.592574:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788582236.592598:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+16:14417:x1875464020920064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788582236.592614:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582236.592641:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d9d8e3000/0x2bc3aa892c3a7fdc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a7fd5 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582236.592669:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d9d8e3000/0x2bc3aa892c3a7fdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7fd5 expref: 17 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582236.592680:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d9d8e3000/0x2bc3aa892c3a7fdc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7fd5 expref: 17 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582236.592689:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d9d8e3000, rc 0) 00000100:00100000:0.0:1788582236.592759:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+17:14417:x1875464020920064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 163us (2024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582236.592767:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788582236.592822:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf433800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020920064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788582236.592839:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fe00/0x2bc3aa892c3a7fd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7fdc expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582236.592849:0:14417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fe00/0x2bc3aa892c3a7fd5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a7fdc expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582236.592915:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf377480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020920192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788582236.592945:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582236.592977:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da337f6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788582236.592987:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020920192 00000100:00100000:3.0:1788582236.592992:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020920192 00000100:00100000:3.0:1788582236.593022:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788582236.593029:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+17:14417:x1875464020920192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788582236.593365:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+17:14417:x1875464020920192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 336us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582236.593373:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788582236.594609:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf377480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020920192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788582236.594678:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020920320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788582236.594739:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582236.594778:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8a21ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1788582236.594800:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020920320 00000100:00100000:3.0:1788582236.594807:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020920320 00000100:00100000:3.0:1788582236.594858:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1788582236.594866:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+17:14417:x1875464020920320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788582236.595132:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+17:14417:x1875464020920320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 265us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582236.595147:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788582236.595240:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020920320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788582236.603176:0:16573:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788582236.603761:0:14417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788582236.603785:0:14417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788582236.603798:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fe00/0x2bc3aa892c3a7fd5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7fdc expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582236.603811:0:14417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0d8138fe00/0x2bc3aa892c3a7fd5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7fdc expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788582236.603822:0:14417:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788582236.603825:0:14417:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0dbfa13000 from 10 10000000:01000000:2.0:1788582236.603828:0:14417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788582236.603878:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05000/0x2bc3aa892c3a7fe3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582236.603886:0:14417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05000/0x2bc3aa892c3a7fe3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582236.603897:0:14417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05000/0x2bc3aa892c3a7fe3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582236.603943:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020920448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788582236.604026:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582236.604082:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8ab2a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788582236.604389:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020920448 00000100:00100000:1.0:1788582236.604398:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020920448 00000100:00100000:1.0:1788582236.604596:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788582236.604606:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+17:14417:x1875464020920448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788582236.604620:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582236.604711:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0c81a80a00/0x2bc3aa892c3a7fea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a7fe3 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582236.604739:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0c81a80a00/0x2bc3aa892c3a7fea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7fe3 expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582236.604751:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0c81a80a00/0x2bc3aa892c3a7fea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7fe3 expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582236.604769:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0c81a80a00, rc 0) 00000100:00100000:1.0:1788582236.604815:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+18:14417:x1875464020920448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 210us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582236.604822:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788582236.605092:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020920448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788582236.605111:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05000/0x2bc3aa892c3a7fe3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7fea expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582236.605123:0:14417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05000/0x2bc3aa892c3a7fe3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a7fea expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582236.605238:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020920576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788582236.605271:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582236.605323:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8ab2a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788582236.605337:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020920576 00000100:00100000:2.0:1788582236.605341:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020920576 00000100:00100000:2.0:1788582236.605365:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788582236.605371:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+18:14417:x1875464020920576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788582236.605976:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+18:14417:x1875464020920576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 601us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582236.605984:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788582236.606027:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020920576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788582236.606059:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020920704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788582236.606097:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582236.606113:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dac215540 going to sleep for 11 seconds 00000100:00100000:2.0:1788582236.606133:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020920704 00000100:00100000:2.0:1788582236.606136:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020920704 00000100:00100000:2.0:1788582236.606159:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788582236.606166:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+18:14417:x1875464020920704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788582236.606734:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+18:14417:x1875464020920704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 566us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582236.606742:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788582236.606788:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d12300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020920704:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788582236.609758:0:16574:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788582236.620937:0:14417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788582236.620980:0:14417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788582236.620992:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05000/0x2bc3aa892c3a7fe3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7fea expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582236.621006:0:14417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0dbbe05000/0x2bc3aa892c3a7fe3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7fea expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788582236.621018:0:14417:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788582236.621020:0:14417:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d0dbbdde000 from 10 10000000:01000000:1.0:1788582236.621023:0:14417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788582236.621061:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0c81a81600/0x2bc3aa892c3a7ff1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582236.621070:0:14417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.112@tcp lock: ffff8d0c81a81600/0x2bc3aa892c3a7ff1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582236.621081:0:14417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.112@tcp lock: ffff8d0c81a81600/0x2bc3aa892c3a7ff1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582236.621113:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbbdc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020920832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788582236.622903:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582236.623000:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da792ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1788582236.629318:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020920832 00000100:00100000:2.0:1788582236.629336:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020920832 00000100:00100000:2.0:1788582236.629396:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788582236.629408:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+18:14417:x1875464020920832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788582236.629729:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582236.629746:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0dbbe05200/0x2bc3aa892c3a7ff8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x2bc3aa892c3a7ff1 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582236.629774:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0dbbe05200/0x2bc3aa892c3a7ff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7ff1 expref: 19 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582236.629785:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0dbbe05200/0x2bc3aa892c3a7ff8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x2bc3aa892c3a7ff1 expref: 19 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582236.629793:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05200, rc 0) 00000100:00100000:2.0:1788582236.629892:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9415e791-1a3c-4924-bcfc-d6d86718d620+19:14417:x1875464020920832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 486us (7259us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582236.629899:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788582236.630066:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbbdc3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020920832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788582236.630097:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.112@tcp lock: ffff8d0c81a81600/0x2bc3aa892c3a7ff1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7ff8 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582236.630109:0:14417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.112@tcp lock: ffff8d0c81a81600/0x2bc3aa892c3a7ff1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x2bc3aa892c3a7ff8 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582236.630191:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020920960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788582236.630253:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582236.630291:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da337f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788582236.630721:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020920960 00000100:00100000:2.0:1788582236.630735:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020920960 00000100:00100000:2.0:1788582236.630766:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788582236.630773:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+19:14417:x1875464020920960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788582236.631103:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+19:14417:x1875464020920960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 329us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582236.631110:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788582236.631671:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020920960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788582236.631712:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020921088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788582236.631757:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582236.631788:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da337f780 going to sleep for 11 seconds 00000100:00100000:2.0:1788582236.631975:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020921088 00000100:00100000:2.0:1788582236.631980:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020921088 00000100:00100000:2.0:1788582236.632019:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788582236.632027:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+19:14417:x1875464020921088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788582236.632185:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+19:14417:x1875464020921088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (427us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582236.632192:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788582236.633482:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:9415e791-1a3c-4924-bcfc-d6d86718d620:14417:1875464020921088:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788582236.634613:0:16576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788582236.635174:0:14417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788582236.635194:0:14417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.201.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788582236.635244:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.112@tcp lock: ffff8d0c81a81600/0x2bc3aa892c3a7ff1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7ff8 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582236.635257:0:14417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.112@tcp lock: ffff8d0c81a81600/0x2bc3aa892c3a7ff1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x2bc3aa892c3a7ff8 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582236.656679:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582236.660775:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020921216:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788582236.660852:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582236.663329:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020921216 00000100:00100000:3.0:1788582236.663343:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020921216 00000100:00100000:3.0:1788582236.663423:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788582236.663443:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020921216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788582236.663478:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788582236.663587:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788582236.667682:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020921216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4238us (6818us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582236.667699:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788582236.669545:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020921216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788582237.341858:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582237.341947:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002059520 00000100:00100000:3.0:1788582237.341962:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002059520 00000100:00100000:3.0:1788582237.343522:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 113 00000100:00100000:3.0:1788582237.343539:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dab7f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+11:13753:x1875464002059520:12345-192.168.201.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788582237.343559:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582237.343588:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8138f000/0x2bc3aa892c3a7fff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9569 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582237.343618:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8138f000/0x2bc3aa892c3a7fff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9569 expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582237.343630:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8138f000/0x2bc3aa892c3a7fff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9569 expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582237.343640:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8138f000, rc 0) 00000100:00100000:3.0:1788582237.343712:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dab7f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+12:13753:x1875464002059520:12345-192.168.201.12@tcp:101:ll_cfg_requeue.0 Request processed in 178us (1867us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582237.343729:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 113 00000100:00100000:1.0:1788582237.350932:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582237.351032:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002059648 00000100:00100000:3.0:1788582237.351043:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002059648 00000100:00100000:3.0:1788582237.351097:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 114 00000100:00100000:3.0:1788582237.351109:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+12:13753:x1875464002059648:12345-192.168.201.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788582237.351858:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+12:13753:x1875464002059648:12345-192.168.201.12@tcp:501:ll_cfg_requeue.0 Request processed in 747us (931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582237.351869:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 114 00000100:00100000:1.0:1788582237.357848:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582237.357913:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002059776 00000100:00100000:0.0:1788582237.357922:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002059776 00000100:00100000:0.0:1788582237.357983:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 115 00000100:00100000:0.0:1788582237.358001:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+12:13753:x1875464002059776:12345-192.168.201.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788582237.358234:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+12:13753:x1875464002059776:12345-192.168.201.12@tcp:503:ll_cfg_requeue.0 Request processed in 235us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582237.358242:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 115 00000100:00100000:1.0:1788582237.366366:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582237.366467:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002059904 00000100:00100000:3.0:1788582237.366481:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002059904 00000100:00100000:3.0:1788582237.366542:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 116 00000100:00100000:3.0:1788582237.366554:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+12:13753:x1875464002059904:12345-192.168.201.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788582237.366583:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582237.366602:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d0d8138ee00/0x2bc3aa892c3a8006 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9570 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582237.366632:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d0d8138ee00/0x2bc3aa892c3a8006 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9570 expref: 13 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582237.366642:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d0d8138ee00/0x2bc3aa892c3a8006 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9570 expref: 13 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582237.366653:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8138ee00, rc 0) 00000100:00100000:3.0:1788582237.366720:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+13:13753:x1875464002059904:12345-192.168.201.12@tcp:101:ll_cfg_requeue.0 Request processed in 168us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582237.366727:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 116 00000100:00100000:1.0:1788582237.369547:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582237.369634:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002060032 00000100:00100000:0.0:1788582237.369645:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002060032 00000100:00100000:0.0:1788582237.369698:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 117 00000100:00100000:0.0:1788582237.369708:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c32afc4-6db4-4783-a556-081dabcc0c13+13:13753:x1875464002060032:12345-192.168.201.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788582237.370008:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7c32afc4-6db4-4783-a556-081dabcc0c13+13:13753:x1875464002060032:12345-192.168.201.12@tcp:501:ll_cfg_requeue.0 Request processed in 299us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582237.370015:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 117 00000100:00100000:1.0:1788582237.379711:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582237.379785:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002060160 00000100:00100000:3.0:1788582237.379795:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002060160 00000100:00100000:3.0:1788582237.379853:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 118 00000100:00100000:3.0:1788582237.379864:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+13:13753:x1875464002060160:12345-192.168.201.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788582237.380222:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+13:13753:x1875464002060160:12345-192.168.201.12@tcp:503:ll_cfg_requeue.0 Request processed in 340us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582237.380231:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 118 00010000:00010000:1.0:1788582237.677437:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582238.558047:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582238.558365:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002060288 00000100:00100000:0.0:1788582238.558376:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002060288 00000100:00080000:1.0:1788582238.558443:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788582238.558463:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 15 00000100:00100000:0.0:1788582238.558475:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:14408:x1875464002060288:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788582238.558495:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582238.558516:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a800d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9577 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.558591:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2800/0x2bc3aa892c3a8014 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.558604:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2800/0x2bc3aa892c3a8014 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.558619:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2800/0x2bc3aa892c3a8014 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.558651:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3200/0x2bc3aa892c3a801b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.558658:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3200/0x2bc3aa892c3a801b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.558665:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3200/0x2bc3aa892c3a801b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.558989:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3400/0x2bc3aa892c3a8022 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.558999:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3400/0x2bc3aa892c3a8022 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.559006:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3400/0x2bc3aa892c3a8022 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582238.559029:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788582238.559032:0:14421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788582238.559071:0:14421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3400/0x2bc3aa892c3a8022 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.559082:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2800/0x2bc3aa892c3a8014 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.559089:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2800/0x2bc3aa892c3a8014 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.559096:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2800/0x2bc3aa892c3a8014 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.559112:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582238.559116:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2800/0x2bc3aa892c3a8014 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.559124:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2800/0x2bc3aa892c3a8014 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.559136:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d9188b400) 00010000:00010000:0.0:1788582238.559139:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582238.559144:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2800/0x2bc3aa892c3a8014 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.559150:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2800/0x2bc3aa892c3a8014 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.559161:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3200/0x2bc3aa892c3a801b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.559167:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3200/0x2bc3aa892c3a801b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.559172:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3200/0x2bc3aa892c3a801b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.559176:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e3200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582238.559178:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3200/0x2bc3aa892c3a801b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.559183:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3200/0x2bc3aa892c3a801b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.559303:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d0d9450d200) 00010000:00010000:0.0:1788582238.559306:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582238.559309:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3200/0x2bc3aa892c3a801b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.559315:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3200/0x2bc3aa892c3a801b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.559351:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a800d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9577 expref: 8 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.559364:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3400/0x2bc3aa892c3a8022 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9577 expref: 7 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.559371:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d0d9450d400) 00010000:00010000:0.0:1788582238.559374:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788582238.559376:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d9d8e3400, rc 0) 00000100:00100000:0.0:1788582238.559433:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+7:14408:x1875464002060288:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 960us (1411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582238.559441:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 15 00000100:00100000:1.0:1788582238.566994:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582238.567062:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002060544 00000100:00100000:2.0:1788582238.567073:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002060544 00000100:00100000:2.0:1788582238.567391:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 16 00000100:00100000:2.0:1788582238.567406:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbbdc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+7:14408:x1875464002060544:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788582238.567430:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582238.567452:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a8029 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c957e expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.567530:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a8030 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.567573:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a8030 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.567586:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a8030 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.567637:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a8037 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.567646:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a8037 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.567653:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a8037 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.568057:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05a00/0x2bc3aa892c3a803e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.568067:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05a00/0x2bc3aa892c3a803e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.568075:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05a00/0x2bc3aa892c3a803e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582238.568086:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788582238.568320:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a8030 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.568330:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a8030 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.568336:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a8030 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.568349:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05e00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582238.568354:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a8030 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.568361:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a8030 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.568374:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d0d9450d400) 00010000:00010000:2.0:1788582238.568378:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582238.568383:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a8030 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.568390:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a8030 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.568403:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a8037 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.568409:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a8037 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.568415:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a8037 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.568420:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582238.568422:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a8037 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.568428:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a8037 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.568447:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d0d85afca00) 00010000:00010000:2.0:1788582238.568450:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582238.568453:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a8037 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.568459:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a8037 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.570075:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a8029 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c957e expref: 10 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.570190:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05a00/0x2bc3aa892c3a803e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c957e expref: 9 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.570221:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d0d85afc400) 00010000:00010000:2.0:1788582238.570225:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582238.570228:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05a00, rc 0) 00000100:00100000:2.0:1788582238.570308:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbbdc3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+9:14408:x1875464002060544:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 2904us (3324us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788582238.570317:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 16 00000100:00100000:1.0:1788582238.573467:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582238.573562:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002060672 00000100:00100000:0.0:1788582238.573572:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002060672 00000100:00100000:0.0:1788582238.573637:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 17 00000100:00100000:0.0:1788582238.573649:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+9:14408:x1875464002060672:12345-192.168.201.12@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788582238.573777:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+9:14408:x1875464002060672:12345-192.168.201.12@tcp:59:lhsmtool_posix.0 Request processed in 129us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582238.573785:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 17 00000100:00100000:1.0:1788582238.602803:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582238.602915:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002060800 00000100:00100000:2.0:1788582238.602925:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002060800 00000100:00100000:2.0:1788582238.602996:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 18 00000100:00100000:2.0:1788582238.603006:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+9:14414:x1875464002060800:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:2.0:1788582238.603025:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582238.603042:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a804c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9585 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603113:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a8053 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603125:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a8053 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603133:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a8053 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603143:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a805a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603147:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a805a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603151:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a805a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603357:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a8053 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603363:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a8053 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603367:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a8053 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603371:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582238.603374:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a8053 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603385:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a8053 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603394:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d9188b400) 00010000:00010000:2.0:1788582238.603396:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582238.603399:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a8053 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603403:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a8053 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603413:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a805a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603416:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a805a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603420:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a805a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603423:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05e00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582238.603424:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a805a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603427:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a805a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603431:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d0d85afca00) 00010000:00010000:2.0:1788582238.603432:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582238.603434:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a805a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603443:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05e00/0x2bc3aa892c3a805a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603466:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a804c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9585 expref: 10 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603472:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d9188b400) 00010000:00010000:2.0:1788582238.603474:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788582238.603476:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a804c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9585 expref: 10 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.603482:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04800, rc 0) 00000100:00100000:2.0:1788582238.603525:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+9:14414:x1875464002060800:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 521us (733us total) trans 0 rc 301/301 00000100:00100000:2.0:1788582238.603529:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 18 00000100:00100000:1.0:1788582238.608100:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582238.608747:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002060928 00000100:00100000:0.0:1788582238.608758:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002060928 00000100:00100000:0.0:1788582238.608817:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 0 00000100:00100000:0.0:1788582238.608830:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3db2c11a-8b82-4246-9cf9-9575f62f5233+9:14414:x1875464002060928:12345-192.168.201.12@tcp:700:lfs.0 00000100:00100000:0.0:1788582238.608919:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3db2c11a-8b82-4246-9cf9-9575f62f5233+9:14414:x1875464002060928:12345-192.168.201.12@tcp:700:lfs.0 Request processed in 93us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582238.608928:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 0 00000100:00100000:1.0:1788582238.613363:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582238.615078:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002061184 00000100:00100000:2.0:1788582238.615092:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002061184 00000100:00100000:2.0:1788582238.615167:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 19 00000100:00100000:2.0:1788582238.615186:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+9:14414:x1875464002061184:12345-192.168.201.12@tcp:36:lfs.0 00010000:00010000:2.0:1788582238.615500:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582238.615528:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a7f8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9500 expref: 9 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.616028:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d9188b400) 00010000:00010000:2.0:1788582238.616034:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788582238.616401:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a8061 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.616424:0:14422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7fc7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9562 expref: 5 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.616433:0:14422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a8061 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.616468:0:14422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9562 expref: 5 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.616484:0:14422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7fc7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9562 expref: 5 pid: 14422 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582238.616501:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14422:1875464020921344:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582238.617056:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8a976d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788582238.619099:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d12d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14422:1875464020921344:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582238.619129:0:14422:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a8061 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582238.619746:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582238.620084:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002061312 00000100:00100000:2.0:1788582238.620093:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002061312 00010000:00010000:2.0:1788582238.620240:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7fc7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9562 expref: 6 pid: 14422 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582238.620273:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 9 00000100:00100000:2.0:1788582238.620284:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+6:2349:x1875464002061312:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788582238.620297:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582238.620318:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7fc7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9562 expref: 6 pid: 14422 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.620335:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7fc7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9562 expref: 6 pid: 14422 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.620356:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a7fc7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9562 expref: 6 pid: 14422 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.620371:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d9188b400) 00010000:00010000:2.0:1788582238.620376:0:14406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a8061 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.620385:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a8061 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.620392:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a8061 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.620423:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582238.620472:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+5:2349:x1875464002061312:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 191us (728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582238.620479:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 9 00010000:00010000:0.0:1788582238.622614:0:14422:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a8061 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.622628:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a8061 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.622655:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8068 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.622665:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8068 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.622673:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8068 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788582238.622808:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:0.0:1788582238.623883:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788582238.623894:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a8061 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.623899:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a8061 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.623904:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a8061 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.623916:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582238.623920:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a8061 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.623925:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a8061 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.623935:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d9188b400) 00010000:00010000:0.0:1788582238.623937:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582238.623940:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a8061 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.623944:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a8061 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788582238.623960:0:14422:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000040a01a0d reply state 0000000062664dc7 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8068 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582238.623966:0:14422:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788582238.624065:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+10:14414:x1875464002061184:12345-192.168.201.12@tcp:36:lfs.0 Request processed in 8884us (10708us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1788582238.624076:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 19 00010000:00010000:0.0:1788582238.627802:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8068 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.627817:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8068 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.627822:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8068 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.627833:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582238.627837:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8068 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.627842:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8068 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.627856:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d0d9450d200) 00010000:00010000:0.0:1788582238.627858:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582238.627860:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8068 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.627865:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8068 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582238.680796:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582238.681647:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002061440 00000100:00100000:0.0:1788582238.681736:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002061440 00000100:00100000:0.0:1788582238.681850:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 20 00000100:00100000:0.0:1788582238.681862:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+9:14422:x1875464002061440:12345-192.168.201.12@tcp:101:lctl.0 00010000:00010000:0.0:1788582238.681887:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582238.681921:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a806f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c958c expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.681998:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3200/0x2bc3aa892c3a8076 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.682011:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3200/0x2bc3aa892c3a8076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.682040:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3200/0x2bc3aa892c3a8076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582238.682071:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788582238.682074:0:14421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788582238.682112:0:14421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3200/0x2bc3aa892c3a8076 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.682135:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a806f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c958c expref: 11 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.682154:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3200/0x2bc3aa892c3a8076 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c958c expref: 10 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.682159:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d9450d200) 00010000:00010000:0.0:1788582238.682161:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788582238.682164:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d9d8e3200, rc 0) 00000100:00100000:0.0:1788582238.682479:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+10:14422:x1875464002061440:12345-192.168.201.12@tcp:101:lctl.0 Request processed in 620us (1699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582238.682485:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 20 00010000:00010000:3.0:1788582238.704531:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582238.711199:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582238.711477:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002061568 00000100:00100000:0.0:1788582238.711488:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002061568 00000100:00100000:0.0:1788582238.711560:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 21 00000100:00100000:0.0:1788582238.711570:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+5:14423:x1875464002061568:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:0.0:1788582238.711592:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582238.711611:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a807d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9593 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.711715:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2800/0x2bc3aa892c3a8084 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.711731:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2800/0x2bc3aa892c3a8084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.711743:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2800/0x2bc3aa892c3a8084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582238.711779:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788582238.711783:0:14422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788582238.711801:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2800/0x2bc3aa892c3a8084 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.711824:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a807d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9593 expref: 7 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.711842:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2800/0x2bc3aa892c3a8084 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9593 expref: 6 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.711850:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d9450d200) 00010000:00010000:0.0:1788582238.711853:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788582238.711857:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d9d8e2800, rc 0) 00000100:00100000:0.0:1788582238.711927:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+6:14423:x1875464002061568:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 358us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582238.712566:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 21 00000100:00100000:1.0:1788582238.715521:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582238.715608:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002061696 00000100:00100000:0.0:1788582238.715620:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002061696 00000100:00100000:0.0:1788582238.715711:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 22 00000100:00100000:0.0:1788582238.715722:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+6:14423:x1875464002061696:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:0.0:1788582238.715742:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582238.715762:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a808b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c959a expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.715844:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a8092 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.715860:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a8092 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.715872:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a8092 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.715889:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a8099 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.715896:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a8099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.715904:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a8099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.716071:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a80a0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.716081:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a80a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.716089:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a80a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582238.716131:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788582238.716135:0:14421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788582238.716155:0:14421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a80a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.716166:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a8092 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.716174:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a8092 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.716181:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a8092 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.716187:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582238.716192:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a8092 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.716245:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a8092 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.716259:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d9450d200) 00010000:00010000:0.0:1788582238.716262:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582238.716551:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a8092 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.716559:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a8092 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.716573:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a8099 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.716588:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a8099 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.716594:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a8099 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.716598:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582238.716601:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a8099 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.716607:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a8099 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.716614:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d0d9450d700) 00010000:00010000:0.0:1788582238.716617:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582238.716620:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a8099 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.716626:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a8099 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.716660:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a808b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c959a expref: 8 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.716672:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a80a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c959a expref: 7 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.716679:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d0d9450dc00) 00010000:00010000:0.0:1788582238.716681:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788582238.716688:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d9d8e3a00, rc 0) 00000100:00100000:0.0:1788582238.716748:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+7:14423:x1875464002061696:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 1027us (1237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582238.716755:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 22 00000100:00100000:1.0:1788582238.725336:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582238.725493:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002061952 00000100:00100000:2.0:1788582238.725506:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002061952 00000100:00100000:2.0:1788582238.725580:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 23 00000100:00100000:2.0:1788582238.725592:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+7:14423:x1875464002061952:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:2.0:1788582238.725617:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582238.725655:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a80a7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c95a1 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582238.725774:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788582238.725912:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a80a7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95a1 expref: 9 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.725939:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d9450d200) 00010000:00010000:2.0:1788582238.725943:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788582238.725949:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a80a7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95a1 expref: 9 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.725965:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05400, rc 0) 00000100:00100000:2.0:1788582238.726032:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+8:14423:x1875464002061952:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 442us (709us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788582238.726040:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 23 00000100:00100000:1.0:1788582238.729113:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582238.729176:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002062208 00000100:00100000:2.0:1788582238.729186:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002062208 00000100:00100000:2.0:1788582238.729355:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 24 00000100:00100000:2.0:1788582238.729367:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+8:14423:x1875464002062208:12345-192.168.201.12@tcp:36:lfs.0 00010000:00010000:2.0:1788582238.729423:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582238.729450:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a80a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c959a expref: 8 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.729466:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d0d9450dc00) 00010000:00010000:2.0:1788582238.729474:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788582238.729493:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a80b5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.729517:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a80b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582238.729523:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a80b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788582238.729757:0:14422:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cdeabbcd reply state 00000000dbdba6f9 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a80b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582238.729766:0:14422:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788582238.729774:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1788582238.729857:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+9:14423:x1875464002062208:12345-192.168.201.12@tcp:36:lfs.0 Request processed in 491us (753us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788582238.731041:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 24 00010000:00010000:0.0:1788582238.739264:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a80b5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.739353:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a80b5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.739362:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a80b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.739368:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582238.739372:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a80b5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.739379:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a80b5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.739397:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d0d85afca00) 00010000:00010000:0.0:1788582238.739400:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788582238.739404:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a80b5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.739410:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04200/0x2bc3aa892c3a80b5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582238.741460:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582238.742576:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002062464 00000100:00100000:2.0:1788582238.742592:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002062464 00000100:00100000:2.0:1788582238.742664:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 2 00000100:00100000:2.0:1788582238.742675:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+8:14423:x1875464002062464:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:2.0:1788582238.745643:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+9:14423:x1875464002062464:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 2955us (4180us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788582238.745659:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 2 00000100:00100000:1.0:1788582238.749338:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582238.749421:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002062720 00000100:00100000:0.0:1788582238.749433:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002062720 00000100:00100000:0.0:1788582238.749560:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 25 00000100:00100000:0.0:1788582238.749573:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+9:14423:x1875464002062720:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:0.0:1788582238.749612:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582238.749632:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a80bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c95a8 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.749861:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a80c3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.749877:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a80c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.749888:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a80c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.749903:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a80ca lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.749910:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a80ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.749917:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a80ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582238.750037:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788582238.750127:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a80c3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.750136:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a80c3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.750143:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a80c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.750158:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582238.750162:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a80c3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.750169:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a80c3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.750181:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d9450d200) 00010000:00010000:0.0:1788582238.750184:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582238.750188:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a80c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.750194:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a80c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.750241:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a80ca lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.750247:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a80ca lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.750253:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a80ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.750257:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582238.750260:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a80ca lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.750275:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a80ca lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.750293:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d0d9450d700) 00010000:00010000:0.0:1788582238.750295:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582238.750297:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a80ca lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.750302:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a80ca lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.750338:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a80bc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95a8 expref: 11 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.750348:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d9450d200) 00010000:00010000:0.0:1788582238.750351:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788582238.750354:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a80bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95a8 expref: 11 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.750362:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d9d8e2e00, rc 0) 00000100:00100000:0.0:1788582238.750427:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+10:14423:x1875464002062720:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 856us (1167us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1788582238.750436:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 25 00000100:00100000:1.0:1788582238.753957:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582238.754072:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002062848 00000100:00100000:0.0:1788582238.754083:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002062848 00000100:00100000:0.0:1788582238.754134:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 26 00000100:00100000:0.0:1788582238.754146:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+10:14423:x1875464002062848:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:0.0:1788582238.754177:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582238.754228:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a80d8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c95af expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.754376:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a80df lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.754390:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a80df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.754402:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a80df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582238.754429:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788582238.754432:0:14422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788582238.754450:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a80df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.754474:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a80d8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95af expref: 12 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.754490:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a80df lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95af expref: 11 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.754498:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d0d9450d000) 00010000:00010000:0.0:1788582238.754501:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788582238.754504:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d9d8e3800, rc 0) 00000100:00100000:0.0:1788582238.754563:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+11:14423:x1875464002062848:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 419us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582238.754570:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 26 00000100:00100000:1.0:1788582238.758074:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582238.758151:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002062976 00000100:00100000:3.0:1788582238.758161:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002062976 00000100:00100000:3.0:1788582238.758590:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 3 00000100:00100000:3.0:1788582238.758605:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+11:14423:x1875464002062976:12345-192.168.201.12@tcp:37:lfs.0 00000100:00100000:3.0:1788582238.764110:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+11:14423:x1875464002062976:12345-192.168.201.12@tcp:37:lfs.0 Request processed in 5500us (6037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582238.764121:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 3 00000100:00100000:1.0:1788582238.768360:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582238.768610:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002063232 00000100:00100000:2.0:1788582238.768622:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002063232 00000100:00100000:2.0:1788582238.768689:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 4 00000100:00100000:2.0:1788582238.768700:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db65af450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+11:14423:x1875464002063232:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:2.0:1788582238.769005:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db65af450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+12:14423:x1875464002063232:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 305us (654us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1788582238.769028:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 4 00000100:00100000:1.0:1788582238.803582:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582238.804261:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002063360 00000100:00100000:0.0:1788582238.804273:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002063360 00000100:00100000:0.0:1788582238.804365:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 27 00000100:00100000:0.0:1788582238.804376:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+10:14429:x1875464002063360:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:0.0:1788582238.804398:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582238.804420:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a80e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c95b6 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.804489:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a80ed lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.804503:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a80ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.804515:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a80ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.804532:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a80f4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.804551:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a80f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.804559:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a80f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.804656:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a80fb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.804664:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a80fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.804671:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a80fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582238.805450:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788582238.805456:0:14421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788582238.805509:0:14421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a80fb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.805523:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a80ed lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.805530:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a80ed lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.805537:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a80ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.805552:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2e00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582238.805566:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a80ed lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.805575:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a80ed lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.805589:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d9450d200) 00010000:00010000:0.0:1788582238.805592:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582238.805605:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a80ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.805612:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a80ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.805641:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a80f4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.805659:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a80f4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.805665:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a80f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.805670:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582238.805673:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a80f4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.805678:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a80f4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.805686:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff8d0d9450d700) 00010000:00010000:0.0:1788582238.805688:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582238.805691:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a80f4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.805705:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a80f4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.805744:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a80e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95b6 expref: 12 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.805757:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2c00/0x2bc3aa892c3a80fb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95b6 expref: 11 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.805765:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d0d9450d000) 00010000:00010000:0.0:1788582238.805767:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788582238.805776:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d9d8e2c00, rc 0) 00000100:00100000:0.0:1788582238.807028:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+11:14429:x1875464002063360:12345-192.168.201.12@tcp:101:bash.0 Request processed in 1470us (2281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582238.807045:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 27 00000100:00100000:1.0:1788582238.809284:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582238.809403:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002063616 00000100:00100000:0.0:1788582238.809413:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002063616 00000100:00100000:0.0:1788582238.809469:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 28 00000100:00100000:0.0:1788582238.809492:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+11:14429:x1875464002063616:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:0.0:1788582238.809513:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582238.809532:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2200/0x2bc3aa892c3a8102 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c95bd expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.809683:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a8109 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.809707:0:14422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a80df lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95af expref: 11 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.809716:0:14422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a8109 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.809754:0:14422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a80df lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95af expref: 11 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.809769:0:14422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a80df lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95af expref: 11 pid: 14422 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582238.809784:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf374a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14422:1875464020921472:192.168.201.12@tcp:104: 00000100:00100000:0.0:1788582238.809906:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8a21cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788582238.813038:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582238.813590:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002063744 00000100:00100000:3.0:1788582238.813608:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002063744 00010000:00010000:3.0:1788582238.813660:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a80df lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95af expref: 12 pid: 14422 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582238.813713:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 10 00000100:00100000:3.0:1788582238.813724:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+12:2349:x1875464002063744:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582238.813738:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582238.813746:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a80df lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95af expref: 12 pid: 14422 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582238.813780:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a80df lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95af expref: 12 pid: 14422 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582238.813806:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d0d9450d000) 00010000:00010000:3.0:1788582238.813811:0:14405:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a8109 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582238.813821:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a8109 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582238.813828:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a8109 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582238.813849:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582238.813918:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+12:2349:x1875464002063744:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 195us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582238.814199:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 10 00010000:00010000:0.0:1788582238.816105:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a80df lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95af expref: 11 pid: 14422 timeout: 557 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582238.816129:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf374a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14422:1875464020921472:192.168.201.12@tcp:104: 00010000:00010000:0.0:1788582238.816151:0:14422:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a8109 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.816160:0:14422:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a8109 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.816166:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a8109 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.816194:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8110 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.816241:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8110 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.816251:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8110 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.818442:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a8117 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.818461:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a8117 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.818474:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a8117 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582238.818854:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788582238.819137:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a8109 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.819146:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a8109 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.819154:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a8109 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.819160:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2600 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582238.819165:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a8109 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.819172:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a8109 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.819185:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d0d9450d000) 00010000:00010000:0.0:1788582238.819188:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582238.819192:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a8109 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.819198:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a8109 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788582238.819301:0:14422:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0d60de3 reply state 00000000015bcea1 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8110 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582238.819311:0:14422:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788582238.819358:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2200/0x2bc3aa892c3a8102 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95bd expref: 14 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.819463:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a8117 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95bd expref: 13 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.819471:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9450df00) 00010000:00010000:0.0:1788582238.819474:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788582238.819476:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d9d8e2400, rc 0) 00000100:00100000:0.0:1788582238.820281:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+14:14429:x1875464002063616:12345-192.168.201.12@tcp:101:bash.0 Request processed in 10800us (11004us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788582238.820292:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 28 00010000:00010000:0.0:1788582238.829450:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8110 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.829469:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8110 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.829476:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8110 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.829481:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582238.829486:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8110 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.829494:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8110 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.829512:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d0d9450d700) 00010000:00010000:0.0:1788582238.829515:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582238.829519:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8110 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.829554:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8110 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582238.842731:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582238.842887:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002063872 00000100:00100000:0.0:1788582238.842898:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002063872 00000100:00100000:0.0:1788582238.842967:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 29 00000100:00100000:0.0:1788582238.842977:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+13:14429:x1875464002063872:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:0.0:1788582238.843005:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582238.843025:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8125 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c95c4 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.843107:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2200/0x2bc3aa892c3a812c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.843123:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2200/0x2bc3aa892c3a812c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.843135:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2200/0x2bc3aa892c3a812c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582238.843180:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788582238.843185:0:14421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788582238.843254:0:14421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2200/0x2bc3aa892c3a812c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.843266:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2200/0x2bc3aa892c3a812c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.843291:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8125 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95c4 expref: 15 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.843333:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2200/0x2bc3aa892c3a812c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95c4 expref: 14 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.843341:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9450df00) 00010000:00010000:0.0:1788582238.843344:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788582238.843348:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d9d8e2200, rc 0) 00000100:00100000:0.0:1788582238.843410:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+14:14429:x1875464002063872:12345-192.168.201.12@tcp:101:bash.0 Request processed in 434us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582238.843418:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 29 00000100:00100000:1.0:1788582238.847164:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582238.849786:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002064128 00000100:00100000:2.0:1788582238.849806:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002064128 00000100:00100000:2.0:1788582238.849887:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 5 00000100:00100000:2.0:1788582238.849898:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+14:14429:x1875464002064128:12345-192.168.201.12@tcp:35:bash.0 00000100:00100000:2.0:1788582238.850306:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+15:14429:x1875464002064128:12345-192.168.201.12@tcp:35:bash.0 Request processed in 408us (3152us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1788582238.850314:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 5 00000100:00100000:1.0:1788582238.918624:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582238.918791:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002064384 00000100:00100000:0.0:1788582238.918802:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002064384 00000100:00100000:0.0:1788582238.918882:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 30 00000100:00100000:0.0:1788582238.918894:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+15:14439:x1875464002064384:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:0.0:1788582238.918922:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582238.918956:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8133 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c95cb expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582238.919065:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788582238.919191:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8133 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95cb expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.919246:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d9450d200) 00010000:00010000:0.0:1788582238.919250:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788582238.919255:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8133 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95cb expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.919287:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d9d8e2000, rc 0) 00000100:00100000:0.0:1788582238.919343:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+16:14439:x1875464002064384:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 451us (742us total) trans 8589934602 rc 301/301 00000100:00100000:0.0:1788582238.919352:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 30 00000100:00100000:1.0:1788582238.923603:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582238.924022:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002064640 00000100:00100000:2.0:1788582238.924036:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002064640 00000100:00100000:2.0:1788582238.924113:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 6 00000100:00100000:2.0:1788582238.924125:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0da702fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+16:14439:x1875464002064640:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:2.0:1788582238.924414:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0da702fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+17:14439:x1875464002064640:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 290us (820us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1788582238.924422:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 6 00000100:00100000:2.0:1788582238.956441:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582238.957012:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002064896 00000100:00100000:0.0:1788582238.957026:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002064896 00000100:00100000:0.0:1788582238.957111:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 31 00000100:00100000:0.0:1788582238.957123:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+17:14442:x1875464002064896:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:0.0:1788582238.957162:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582238.957187:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8141 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c95d2 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.958385:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a8148 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.958404:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a8148 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.958416:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a8148 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582238.958429:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788582238.958637:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8141 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95d2 expref: 20 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.958657:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a8148 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95d2 expref: 19 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.958690:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9450df00) 00010000:00010000:0.0:1788582238.958692:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788582238.958696:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d9d8e2600, rc 0) 00000100:00100000:0.0:1788582238.958783:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d13100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+19:14442:x1875464002064896:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 1661us (2853us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788582238.958791:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 31 00000100:00100000:1.0:1788582238.961813:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582238.961949:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582238.962076:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002065152 00000100:00100000:3.0:1788582238.962088:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002065152 00000100:00100000:3.0:1788582238.962179:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 0 00000100:00100000:3.0:1788582238.962189:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+19:2349:x1875464002065152:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582238.962222:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582238.962250:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a8148 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95d2 expref: 19 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582238.962274:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9450df00) 00010000:00010000:3.0:1788582238.962279:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582238.962364:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+18:2349:x1875464002065152:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 177us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582238.962373:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 0 00000100:00100000:0.0:1788582238.963839:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002065024 00000100:00100000:0.0:1788582238.963851:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002065024 00000100:00100000:0.0:1788582238.964075:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 32 00000100:00100000:0.0:1788582238.964086:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+18:14442:x1875464002065024:12345-192.168.201.12@tcp:54:lfs.0 00010000:00010000:0.0:1788582238.964161:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8156 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.964176:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8156 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.964188:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8156 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.964252:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8156 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.964260:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8156 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.964267:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8156 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.964272:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e3800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582238.964290:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8156 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.964298:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8156 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.964311:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9450df00) 00010000:00010000:0.0:1788582238.964314:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788582238.964319:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8156 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582238.964325:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8156 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582238.964399:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+18:14442:x1875464002065024:12345-192.168.201.12@tcp:54:lfs.0 Request processed in 315us (2595us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582238.964407:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 32 00000100:00100000:1.0:1788582238.967017:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582238.967448:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002065408 00000100:00100000:2.0:1788582238.967461:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002065408 00000100:00100000:2.0:1788582238.967533:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 7 00000100:00100000:2.0:1788582238.967555:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+18:14442:x1875464002065408:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:2.0:1788582238.967816:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+19:14442:x1875464002065408:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 263us (810us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1788582238.967825:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 7 00000040:00080000:3.0:1788582239.086459:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788582239.196310:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582239.196758:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002065664 00000100:00100000:0.0:1788582239.196770:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002065664 00000100:00100000:0.0:1788582239.196837:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 33 00000100:00100000:0.0:1788582239.196846:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+19:14474:x1875464002065664:12345-192.168.201.12@tcp:101:cat.0 00010000:00010000:0.0:1788582239.196871:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582239.196892:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a815d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c95d9 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.196994:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8164 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.197830:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8164 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.197871:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8164 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582239.197887:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788582239.198066:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a815d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95d9 expref: 22 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.198086:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8164 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95d9 expref: 21 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.198095:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9450df00) 00010000:00010000:0.0:1788582239.198097:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788582239.198100:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d9d8e2000, rc 0) 00000100:00100000:0.0:1788582239.198180:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf431c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+21:14474:x1875464002065664:12345-192.168.201.12@tcp:101:cat.0 Request processed in 1333us (1877us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1788582239.198189:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 33 00000100:00100000:0.0:1788582239.200866:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582239.200941:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582239.201035:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002066048 00000100:00100000:2.0:1788582239.201057:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002066048 00000100:00100000:2.0:1788582239.201121:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 8 00000100:00100000:2.0:1788582239.201131:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+21:14474:x1875464002066048:12345-192.168.201.12@tcp:35:cat.0 00000100:00100000:2.0:1788582239.202033:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+22:14474:x1875464002066048:12345-192.168.201.12@tcp:35:cat.0 Request processed in 897us (1085us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1788582239.202045:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 8 00000100:00100000:3.0:1788582239.203182:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002065792 00000100:00100000:3.0:1788582239.203192:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002065792 00000100:00100000:3.0:1788582239.203408:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 1 00000100:00100000:3.0:1788582239.203419:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf374a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+22:2352:x1875464002065792:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582239.203435:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582239.203460:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8164 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95d9 expref: 22 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582239.203478:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9450df00) 00010000:00010000:3.0:1788582239.203483:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582239.203549:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf374a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+21:2352:x1875464002065792:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 131us (2693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582239.203557:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 1 00000100:00100000:0.0:1788582239.342691:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582239.343417:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002066304 00000100:00100000:1.0:1788582239.343434:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002066304 00000100:00100000:1.0:1788582239.343582:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 34 00000100:00100000:1.0:1788582239.343594:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+21:14480:x1875464002066304:12345-192.168.201.12@tcp:101:dd.0 00010000:00010000:1.0:1788582239.343627:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582239.343649:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80200/0x2bc3aa892c3a8172 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c95e0 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582239.343782:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81800/0x2bc3aa892c3a8179 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582239.343799:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81800/0x2bc3aa892c3a8179 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582239.343809:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81800/0x2bc3aa892c3a8179 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582239.343820:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788582239.343990:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80200/0x2bc3aa892c3a8172 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95e0 expref: 24 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582239.344008:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81800/0x2bc3aa892c3a8179 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95e0 expref: 23 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582239.344017:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9450df00) 00010000:00010000:1.0:1788582239.344033:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788582239.344037:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0c81a81800, rc 0) 00000100:00100000:1.0:1788582239.344104:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf377b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+23:14480:x1875464002066304:12345-192.168.201.12@tcp:101:dd.0 Request processed in 511us (1424us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788582239.344112:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 34 00000100:00100000:1.0:1788582239.350694:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582239.357136:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002066560 00000100:00100000:0.0:1788582239.357154:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002066560 00000100:00100000:0.0:1788582239.357306:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 35 00000100:00100000:0.0:1788582239.357319:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+23:14480:x1875464002066560:12345-192.168.201.12@tcp:36:dd.0 00010000:00010000:0.0:1788582239.357453:0:14420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788582239.357484:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81800/0x2bc3aa892c3a8179 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95e0 expref: 23 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.357540:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2200/0x2bc3aa892c3a812c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95c4 expref: 22 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.357553:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9450df00) 00010000:00010000:0.0:1788582239.357557:0:14420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788582239.361929:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8187 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.361972:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8187 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.361986:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8187 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788582239.362058:0:14420:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1788582239.362099:0:14420:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007622e9ba reply state 0000000054b67519 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8187 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582239.362109:0:14420:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788582239.362263:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+24:14480:x1875464002066560:12345-192.168.201.12@tcp:36:dd.0 Request processed in 4942us (11574us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1788582239.362273:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 35 00000020:00080000:0.0:1788582239.362279:0:14420:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788582239.365702:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8187 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.365723:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8187 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.365731:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8187 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.365756:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e3800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582239.365763:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8187 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.365771:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8187 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.365795:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9450df00) 00010000:00010000:0.0:1788582239.365798:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582239.365804:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8187 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.365811:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8187 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582239.488912:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582239.489224:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002066816 00000100:00100000:1.0:1788582239.489238:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002066816 00000100:00100000:1.0:1788582239.489338:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 9 00000100:00100000:1.0:1788582239.489347:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+23:14480:x1875464002066816:12345-192.168.201.12@tcp:35:dd.0 00000100:00100000:1.0:1788582239.489635:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+24:14480:x1875464002066816:12345-192.168.201.12@tcp:35:dd.0 Request processed in 289us (733us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1788582239.489641:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 9 00000100:00100000:0.0:1788582239.728153:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020921600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788582239.728262:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582239.728389:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020921600 00000100:00100000:3.0:1788582239.728397:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020921600 00000100:00100000:3.0:1788582239.728460:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788582239.728469:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020921600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788582239.728502:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788582239.728574:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf375880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020921600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582239.728581:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788582239.728623:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf432680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020921600:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1788582239.728807:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788582239.729055:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582239.730446:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875464020921984:0@lo:400:kworker.0 00000100:00100000:2.0:1788582239.730505:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788582239.730545:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788582239.730551:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020921856:0@lo:400:kworker.0 00000100:00100000:2.0:1788582239.730573:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582239.730906:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020921856 00000100:00100000:0.0:1788582239.730915:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020921856 00000100:00100000:0.0:1788582239.730983:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788582239.730991:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020921856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582239.731047:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d13800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1875464020921856:12345-0@lo:400:kworker.0 Request processed in 56us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582239.731055:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788582239.731099:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020921856:0@lo:400:kworker.0 00000100:00100000:1.0:1788582239.731244:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020921984 00000100:00100000:1.0:1788582239.731249:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020921984 00000100:00100000:1.0:1788582239.731281:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788582239.731288:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875464020921984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582239.731329:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875464020921984:12345-0@lo:400:kworker.0 Request processed in 42us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582239.731335:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788582239.731361:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875464020921984:0@lo:400:kworker.0 00000100:00100000:3.0:1788582239.731970:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9415e791-1a3c-4924-bcfc-d6d86718d620:3309:1875464020921728:0@lo:400:kworker.0 00000100:00100000:3.0:1788582239.732015:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582239.732050:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875464020922240:0@lo:400:kworker.0 00000100:00100000:3.0:1788582239.732075:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582239.732093:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788582239.732099:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875464020922112:0@lo:400:kworker.0 00000100:00100000:3.0:1788582239.732119:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582239.732172:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020921728 00000100:00100000:3.0:1788582239.732178:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020921728 00000100:00100000:3.0:1788582239.732254:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788582239.732262:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+19:3309:x1875464020921728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582239.732305:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9415e791-1a3c-4924-bcfc-d6d86718d620+19:3309:x1875464020921728:12345-0@lo:400:kworker.0 Request processed in 44us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582239.732312:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788582239.732359:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d13b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:9415e791-1a3c-4924-bcfc-d6d86718d620:3309:1875464020921728:0@lo:400:kworker.0 00000100:00100000:0.0:1788582239.732764:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020922240 00000100:00100000:0.0:1788582239.732768:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020922240 00000100:00100000:0.0:1788582239.732824:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020922112 00000100:00100000:0.0:1788582239.732827:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020922112 00000100:00100000:0.0:1788582239.732854:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788582239.732862:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875464020922240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582239.732905:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf432680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875464020922240:12345-0@lo:400:kworker.0 Request processed in 44us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582239.732911:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788582239.732925:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788582239.732931:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875464020922112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788582239.732958:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf432d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875464020922112:12345-0@lo:400:kworker.0 Request processed in 27us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582239.732964:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788582239.733754:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788582239.733761:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788582239.733840:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1875464020922112:0@lo:400:kworker.0 00000100:00100000:3.0:1788582239.733851:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3309:1875464020922240:0@lo:400:kworker.0 00000100:00100000:3.0:1788582239.797829:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582239.797949:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002066944 00000100:00100000:0.0:1788582239.797962:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002066944 00000100:00100000:0.0:1788582239.798024:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 36 00000100:00100000:0.0:1788582239.798036:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+24:14494:x1875464002066944:12345-192.168.201.12@tcp:101:stat.0 00010000:00010000:0.0:1788582239.798060:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582239.798082:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2200/0x2bc3aa892c3a818e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c95e7 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798176:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2a00/0x2bc3aa892c3a8195 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798191:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2a00/0x2bc3aa892c3a8195 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798234:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2a00/0x2bc3aa892c3a8195 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798264:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a819c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798272:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a819c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798279:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a819c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798370:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a81a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798378:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a81a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798385:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a81a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788582239.798416:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1788582239.798419:0:14420:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788582239.798455:0:14420:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a81a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798466:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a81a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798474:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2a00/0x2bc3aa892c3a8195 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798480:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2a00/0x2bc3aa892c3a8195 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798496:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2a00/0x2bc3aa892c3a8195 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798502:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2a00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582239.798506:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2a00/0x2bc3aa892c3a8195 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798513:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2a00/0x2bc3aa892c3a8195 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798536:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d0d9450d000) 00010000:00010000:0.0:1788582239.798539:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582239.798544:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2a00/0x2bc3aa892c3a8195 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798550:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2a00/0x2bc3aa892c3a8195 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798564:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a819c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798570:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a819c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798575:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a819c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798580:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e3800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582239.798583:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a819c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798599:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a819c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798608:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d0d9450d700) 00010000:00010000:0.0:1788582239.798610:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582239.798613:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a819c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798619:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a819c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798648:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2200/0x2bc3aa892c3a818e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95e7 expref: 26 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798662:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a81a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95e7 expref: 25 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.798669:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9450df00) 00010000:00010000:0.0:1788582239.798672:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788582239.798674:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d9d8e2000, rc 0) 00000100:00100000:0.0:1788582239.798743:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf430000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+25:14494:x1875464002066944:12345-192.168.201.12@tcp:101:stat.0 Request processed in 709us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582239.798751:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 36 00000100:00100000:0.0:1788582239.906428:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582239.906501:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002067200 00000100:00100000:3.0:1788582239.906510:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002067200 00000100:00100000:3.0:1788582239.906617:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 37 00000100:00100000:3.0:1788582239.906629:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+25:14500:x1875464002067200:12345-192.168.201.12@tcp:36:truncate.0 00010000:00010000:3.0:1788582239.906682:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582239.906706:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a81a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95e7 expref: 25 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582239.906734:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9450df00) 00010000:00010000:3.0:1788582239.906738:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788582239.906951:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f400/0x2bc3aa892c3a81aa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582239.906969:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f400/0x2bc3aa892c3a81aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582239.906980:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f400/0x2bc3aa892c3a81aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788582239.907022:0:14422:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:3.0:1788582239.907041:0:14422:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b5c2b46 reply state 000000005d335a00 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f400/0x2bc3aa892c3a81aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582239.907049:0:14422:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788582239.907171:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf376680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+27:14500:x1875464002067200:12345-192.168.201.12@tcp:36:truncate.0 Request processed in 544us (752us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1788582239.907177:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 37 00000020:00080000:3.0:1788582239.907180:0:14422:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788582239.909335:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f400/0x2bc3aa892c3a81aa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.909353:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f400/0x2bc3aa892c3a81aa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.909374:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f400/0x2bc3aa892c3a81aa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.909380:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8138f400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582239.909384:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f400/0x2bc3aa892c3a81aa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.909392:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f400/0x2bc3aa892c3a81aa lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.909409:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9450df00) 00010000:00010000:0.0:1788582239.909412:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582239.909417:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f400/0x2bc3aa892c3a81aa lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582239.909423:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f400/0x2bc3aa892c3a81aa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582240.025441:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582240.025588:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002067328 00000100:00100000:1.0:1788582240.025599:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002067328 00000100:00100000:1.0:1788582240.025725:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 38 00000100:00100000:1.0:1788582240.025739:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+26:14514:x1875464002067328:12345-192.168.201.12@tcp:101:stat.0 00010000:00010000:1.0:1788582240.025781:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582240.025803:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80800/0x2bc3aa892c3a81b1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c95ee expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.025870:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a81b8 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.025886:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a81b8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.025899:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a81b8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.025914:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81200/0x2bc3aa892c3a81bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.025920:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81200/0x2bc3aa892c3a81bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.025926:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81200/0x2bc3aa892c3a81bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.026011:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81400/0x2bc3aa892c3a81c6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.026019:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81400/0x2bc3aa892c3a81c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.026026:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81400/0x2bc3aa892c3a81c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582240.026061:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1788582240.026070:0:14421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788582240.026097:0:14421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81400/0x2bc3aa892c3a81c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.026110:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81400/0x2bc3aa892c3a81c6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.026119:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a81b8 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.026125:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a81b8 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.026131:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a81b8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.026137:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0c81a81c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582240.026140:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a81b8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.026147:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a81b8 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.026158:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d0d9450d000) 00010000:00010000:1.0:1788582240.026162:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582240.026167:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a81b8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.026173:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a81b8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.026187:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81200/0x2bc3aa892c3a81bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.026259:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81200/0x2bc3aa892c3a81bf lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.026264:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81200/0x2bc3aa892c3a81bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.026269:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0c81a81200 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582240.026272:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81200/0x2bc3aa892c3a81bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.026278:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81200/0x2bc3aa892c3a81bf lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.026286:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d0d9188b200) 00010000:00010000:1.0:1788582240.026289:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582240.026292:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81200/0x2bc3aa892c3a81bf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.026297:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81200/0x2bc3aa892c3a81bf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.026329:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80800/0x2bc3aa892c3a81b1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95ee expref: 28 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.026341:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81400/0x2bc3aa892c3a81c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95ee expref: 27 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.026349:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9450df00) 00010000:00010000:1.0:1788582240.026351:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788582240.026359:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0c81a81400, rc 0) 00000100:00100000:1.0:1788582240.026423:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf374000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+27:14514:x1875464002067328:12345-192.168.201.12@tcp:101:stat.0 Request processed in 687us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582240.026431:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 38 00000100:00080000:2.0:1788582240.031758:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788582240.085604:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582240.085699:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002067584 00000100:00100000:3.0:1788582240.085711:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002067584 00000100:00100000:3.0:1788582240.085778:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 39 00000100:00100000:3.0:1788582240.085788:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+27:14524:x1875464002067584:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:3.0:1788582240.085811:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582240.085833:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f400/0x2bc3aa892c3a81cd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c95f5 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582240.086417:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788582240.086561:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f400/0x2bc3aa892c3a81cd lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95f5 expref: 29 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582240.086576:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d9450d200) 00010000:00010000:3.0:1788582240.086580:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788582240.086585:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f400/0x2bc3aa892c3a81cd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95f5 expref: 29 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582240.086600:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8138f400, rc 0) 00000100:00100000:3.0:1788582240.086728:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+28:14524:x1875464002067584:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 940us (1133us total) trans 8589934614 rc 301/301 00000100:00100000:3.0:1788582240.086736:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 39 00000100:00100000:0.0:1788582240.090565:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582240.091955:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582240.091993:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582240.092025:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582240.092047:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582240.092075:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002067968 00000100:00100000:3.0:1788582240.092085:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002067968 00000100:00100000:3.0:1788582240.092134:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 120 00000100:00100000:3.0:1788582240.092145:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+13:2350:x1875464002067968:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582240.092242:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7c32afc4-6db4-4783-a556-081dabcc0c13+13:2350:x1875464002067968:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 98us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582240.092250:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 120 00000100:00100000:3.0:1788582240.092296:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582240.092390:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582240.092467:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002068096 00000100:00100000:1.0:1788582240.092472:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002068096 00000100:00100000:1.0:1788582240.092514:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002068608 00000100:00100000:1.0:1788582240.092527:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002068608 00000100:00100000:1.0:1788582240.092542:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002068224 00000100:00100000:1.0:1788582240.092544:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002068224 00000100:00100000:1.0:1788582240.092556:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002068480 00000100:00100000:1.0:1788582240.092558:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002068480 00000100:00100000:1.0:1788582240.092571:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 12 00000100:00100000:1.0:1788582240.092578:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+5:2350:x1875464002068096:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582240.092611:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf430380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+5:2350:x1875464002068096:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 34us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582240.092617:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 12 00000100:00100000:1.0:1788582240.092630:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 13 00000100:00100000:1.0:1788582240.092636:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+5:2350:x1875464002068608:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582240.092657:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf432300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+5:2350:x1875464002068608:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 21us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582240.092663:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 13 00000100:00100000:1.0:1788582240.092672:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 14 00000100:00100000:1.0:1788582240.092677:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+5:2350:x1875464002068224:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582240.092695:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf433b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+5:2350:x1875464002068224:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 18us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582240.092711:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 14 00000100:00100000:1.0:1788582240.092723:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 15 00000100:00100000:1.0:1788582240.092729:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+5:2350:x1875464002068480:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582240.092752:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf433800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+5:2350:x1875464002068480:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 24us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582240.092758:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 15 00000100:00080000:3.0:1788582240.093096:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788582240.093101:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788582240.093180:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002068352 00000100:00100000:0.0:1788582240.093186:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002068352 00000100:00100000:0.0:1788582240.093268:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 23 00000100:00100000:0.0:1788582240.093276:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+11:2350:x1875464002068352:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582240.093317:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf431500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+11:2350:x1875464002068352:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 42us (1323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582240.093324:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 23 00000100:00080000:3.0:1788582240.093405:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788582240.096192:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002067840 00000100:00100000:2.0:1788582240.096267:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002067840 00000100:00100000:2.0:1788582240.096378:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 10 00000100:00100000:2.0:1788582240.096390:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db65ac050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+28:14524:x1875464002067840:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:2.0:1788582240.096683:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db65ac050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+29:14524:x1875464002067840:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 294us (6130us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1788582240.096692:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 10 00000100:00100000:0.0:1788582240.155900:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582240.156077:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002068864 00000100:00100000:2.0:1788582240.156091:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002068864 00000100:00100000:2.0:1788582240.156166:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 40 00000100:00100000:2.0:1788582240.156179:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+29:14530:x1875464002068864:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:2.0:1788582240.156269:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582240.156293:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a81db lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c95fc expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.156412:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a81e2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.156428:0:14420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a8117 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95bd expref: 30 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.156436:0:14420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81400/0x2bc3aa892c3a81c6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95ee expref: 30 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.156444:0:14420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a81e2 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.156487:0:14420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81400/0x2bc3aa892c3a81c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95ee expref: 30 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.156501:0:14420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81400/0x2bc3aa892c3a81c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95ee expref: 30 pid: 14421 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582240.156529:0:14420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d13480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14420:1875464020922368:192.168.201.12@tcp:104: 00010000:00010000:1.0:1788582240.157548:0:14420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a8117 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95bd expref: 30 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.157566:0:14420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a8117 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95bd expref: 30 pid: 14422 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582240.157580:0:14420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d9dd97b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14420:1875464020922496:192.168.201.12@tcp:104: 00000100:00100000:1.0:1788582240.157639:0:14420:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d9dd5e900 going to sleep for 11 seconds 00000100:00100000:1.0:1788582240.160686:0:14420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d13480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14420:1875464020922368:192.168.201.12@tcp:104: 00000100:00100000:1.0:1788582240.160702:0:14420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d9dd97b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14420:1875464020922496:192.168.201.12@tcp:104: 00010000:00010000:1.0:1788582240.160734:0:14420:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a81e2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582240.163009:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582240.163243:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002068992 00000100:00100000:2.0:1788582240.163255:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002068992 00010000:00010000:2.0:1788582240.163299:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81400/0x2bc3aa892c3a81c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95ee expref: 31 pid: 14421 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582240.163360:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 11 00000100:00100000:2.0:1788582240.163371:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbaee1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+31:2349:x1875464002068992:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788582240.163386:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582240.163394:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81400/0x2bc3aa892c3a81c6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95ee expref: 31 pid: 14421 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.163407:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81400/0x2bc3aa892c3a81c6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95ee expref: 31 pid: 14421 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.163430:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81400/0x2bc3aa892c3a81c6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95ee expref: 31 pid: 14421 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.163447:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9450df00) 00010000:00010000:2.0:1788582240.163453:0:14406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a81e2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.163463:0:14406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a81e2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.163469:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582240.163595:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbaee1050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+30:2349:x1875464002068992:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 225us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582240.163603:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 11 00000100:00100000:0.0:1788582240.163786:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582240.164079:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002069120 00000100:00100000:2.0:1788582240.164084:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002069120 00010000:00010000:2.0:1788582240.164102:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a8117 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95bd expref: 30 pid: 14422 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582240.164133:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 12 00000100:00100000:2.0:1788582240.164140:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf374700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+30:2349:x1875464002069120:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788582240.164149:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582240.164154:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a8117 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95bd expref: 30 pid: 14422 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.164164:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a8117 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95bd expref: 30 pid: 14422 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.164178:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2400/0x2bc3aa892c3a8117 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95bd expref: 30 pid: 14422 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.164188:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9450df00) 00010000:00010000:2.0:1788582240.164192:0:14405:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a81e2 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.164228:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a81e2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.164237:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a81e2 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.164261:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582240.164281:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf374700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+29:2349:x1875464002069120:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 142us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582240.164288:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 12 00010000:00010000:2.0:1788582240.164311:0:14420:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a81e2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.164325:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a81e2 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582240.164343:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:2.0:1788582240.164483:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a81db lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95fc expref: 30 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.164499:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a81e2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95fc expref: 29 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.164506:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9450df00) 00010000:00010000:2.0:1788582240.164509:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788582240.164511:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04400, rc 0) 00000100:00100000:2.0:1788582240.164552:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf377480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+29:14530:x1875464002068864:12345-192.168.201.12@tcp:101:bash.0 Request processed in 8376us (8666us total) trans 8589934616 rc 0/0 00000100:00100000:2.0:1788582240.164560:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 40 00000100:00100000:3.0:1788582240.169812:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582240.169917:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002069376 00000100:00100000:1.0:1788582240.169930:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002069376 00000100:00100000:1.0:1788582240.170001:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 41 00000100:00100000:1.0:1788582240.170014:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+29:14530:x1875464002069376:12345-192.168.201.12@tcp:36:bash.0 00010000:00010000:1.0:1788582240.170722:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a81f0 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.170755:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a81f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.170767:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a81f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788582240.170825:0:14422:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:1.0:1788582240.170848:0:14422:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004b3a40ab reply state 00000000c0764c08 transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a81f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582240.170857:0:14422:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788582240.170967:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf430700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+32:14530:x1875464002069376:12345-192.168.201.12@tcp:36:bash.0 Request processed in 953us (1170us total) trans 8589934618 rc 0/0 00000100:00100000:1.0:1788582240.170975:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 41 00000020:00080000:1.0:1788582240.170980:0:14422:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788582240.174154:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582240.174259:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002069504 00000100:00100000:2.0:1788582240.174269:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002069504 00000100:00100000:2.0:1788582240.174336:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 42 00000100:00100000:2.0:1788582240.174348:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+32:14530:x1875464002069504:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:2.0:1788582240.174374:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582240.174398:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a81f7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9603 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.174464:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a81f7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9603 expref: 33 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.174500:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a81f7 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9603 expref: 33 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.174536:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9450df00) 00010000:00010000:2.0:1788582240.174540:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788582240.174544:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04600, rc 0) 00000100:00100000:2.0:1788582240.174610:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf431880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+33:14530:x1875464002069504:12345-192.168.201.12@tcp:101:bash.0 Request processed in 264us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582240.174617:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 42 00010000:00010000:0.0:1788582240.177132:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a81f0 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582240.177153:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a81f0 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582240.177160:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a81f0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582240.177167:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0c81a81c00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582240.177171:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a81f0 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582240.177179:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a81f0 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582240.177199:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9450df00) 00010000:00010000:0.0:1788582240.177219:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582240.177225:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a81f0 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582240.177232:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81c00/0x2bc3aa892c3a81f0 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582240.180538:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582240.180635:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002069632 00000100:00100000:3.0:1788582240.180649:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002069632 00000100:00100000:3.0:1788582240.180726:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 43 00000100:00100000:3.0:1788582240.180736:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+32:14530:x1875464002069632:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:3.0:1788582240.180758:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582240.180778:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f400/0x2bc3aa892c3a81fe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c960a expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582240.180876:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f600/0x2bc3aa892c3a8205 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582240.180892:0:14422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a81e2 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95fc expref: 33 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582240.180901:0:14422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f600/0x2bc3aa892c3a8205 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582240.180958:0:14422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a81e2 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95fc expref: 33 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582240.180974:0:14422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a81e2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95fc expref: 33 pid: 14420 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582240.180989:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf431180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14422:1875464020922624:192.168.201.12@tcp:104: 00000100:00100000:3.0:1788582240.181090:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8722f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788582240.184328:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582240.184454:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002069760 00000100:00100000:2.0:1788582240.184463:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002069760 00010000:00010000:2.0:1788582240.184527:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a81e2 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95fc expref: 34 pid: 14420 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582240.184575:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 13 00000100:00100000:2.0:1788582240.184587:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf430e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+34:2350:x1875464002069760:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788582240.184605:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582240.184613:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a81e2 lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95fc expref: 34 pid: 14420 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.184628:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a81e2 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95fc expref: 34 pid: 14420 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.184654:0:14405:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9450df00) 00010000:00010000:2.0:1788582240.184674:0:14405:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f600/0x2bc3aa892c3a8205 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.184701:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f600/0x2bc3aa892c3a8205 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.184708:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f600/0x2bc3aa892c3a8205 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.184734:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582240.184797:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf430e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+34:2350:x1875464002069760:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 212us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582240.184805:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 13 00010000:00010000:1.0:1788582240.185003:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a81e2 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c95fc expref: 33 pid: 14420 timeout: 559 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582240.185022:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf431180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14422:1875464020922624:192.168.201.12@tcp:104: 00010000:00010000:1.0:1788582240.185044:0:14422:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f600/0x2bc3aa892c3a8205 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.185053:0:14422:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f600/0x2bc3aa892c3a8205 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.185059:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f600/0x2bc3aa892c3a8205 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582240.185117:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788582240.185122:0:14422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788582240.185144:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f600/0x2bc3aa892c3a8205 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.185183:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f400/0x2bc3aa892c3a81fe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c960a expref: 33 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.185198:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f600/0x2bc3aa892c3a8205 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c960a expref: 32 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.185259:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9450df00) 00010000:00010000:1.0:1788582240.185262:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788582240.185265:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8138f600, rc 0) 00000100:00100000:1.0:1788582240.185292:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+32:14530:x1875464002069632:12345-192.168.201.12@tcp:101:bash.0 Request processed in 4558us (4776us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582240.185300:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 43 00000100:00100000:1.0:1788582240.188943:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582240.189068:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002070016 00000100:00100000:2.0:1788582240.189077:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002070016 00000100:00100000:2.0:1788582240.189140:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 2 00000100:00100000:2.0:1788582240.189149:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+32:14530:x1875464002070016:12345-192.168.201.12@tcp:103:bash.0 00010000:00010000:2.0:1788582240.189164:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788582240.189194:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f600/0x2bc3aa892c3a8205 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c960a expref: 32 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.189256:0:14407:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a81f7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9603 expref: 31 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582240.189267:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9450df00) 00010000:00010000:2.0:1788582240.189276:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582240.189332:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd96300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+30:14530:x1875464002070016:12345-192.168.201.12@tcp:103:bash.0 Request processed in 184us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582240.189340:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 2 00000100:00100000:0.0:1788582240.191751:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582240.192152:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002070144 00000100:00100000:1.0:1788582240.192163:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002070144 00000100:00100000:1.0:1788582240.192411:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 44 00000100:00100000:1.0:1788582240.192423:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+30:14530:x1875464002070144:12345-192.168.201.12@tcp:58:bash.0 00010000:00010000:1.0:1788582240.192537:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81e00/0x2bc3aa892c3a820c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.192554:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81e00/0x2bc3aa892c3a820c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.192582:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81e00/0x2bc3aa892c3a820c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788582240.194429:0:14421:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788582240.194608:0:14421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:1.0:1788582240.194750:0:14421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:1.0:1788582240.195085:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf374a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+30:14530:x1875464002070144:12345-192.168.201.12@tcp:58:bash.0 Request processed in 2648us (3332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582240.195099:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 44 00000100:00100000:0.0:1788582240.197565:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582240.197682:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002070272 00000100:00100000:1.0:1788582240.197694:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002070272 00000100:00100000:1.0:1788582240.197750:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 45 00000100:00100000:1.0:1788582240.197760:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+30:14530:x1875464002070272:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:1.0:1788582240.197779:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788582240.197798:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80600/0x2bc3aa892c3a8213 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9611 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.197856:0:14422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81e00/0x2bc3aa892c3a820c lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.197865:0:14422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80600/0x2bc3aa892c3a8213 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9611 expref: 31 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.197886:0:14422:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81e00/0x2bc3aa892c3a820c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.197897:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80600/0x2bc3aa892c3a8213 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9611 expref: 31 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.198241:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9188b200) 00010000:00010000:1.0:1788582240.198244:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788582240.198249:0:14422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80600/0x2bc3aa892c3a8213 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9611 expref: 31 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582240.198257:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0c81a80600, rc 0) 00000100:00100000:1.0:1788582240.198308:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf377800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+31:14530:x1875464002070272:12345-192.168.201.12@tcp:101:bash.0 Request processed in 549us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582240.198315:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 45 00010000:00010000:0.0:1788582240.749559:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788582241.133486:0:14451:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788582241.133546:0:14451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788582241.133640:0:14451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788582241.133647:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788582241.133780:0:14451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbf431180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14451:1875464020922752:192.168.201.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788582241.135001:0:14451:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8722fb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788582241.143779:0:14451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbf431180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14451:1875464020922752:192.168.201.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788582241.150065:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582241.150254:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002070400 00000100:00100000:2.0:1788582241.150278:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002070400 00000100:00100000:2.0:1788582241.150471:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 0 00000100:00100000:2.0:1788582241.150483:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3db2c11a-8b82-4246-9cf9-9575f62f5233+31:14531:x1875464002070400:12345-192.168.201.12@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788582241.150758:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3db2c11a-8b82-4246-9cf9-9575f62f5233+31:14531:x1875464002070400:12345-192.168.201.12@tcp:900:lhsmtool_posix.0 Request processed in 276us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582241.150766:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 0 00000100:00100000:0.0:1788582241.159864:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582241.160040:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002070528 00000100:00100000:1.0:1788582241.160051:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002070528 00000100:00100000:1.0:1788582241.160125:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 46 00000100:00100000:1.0:1788582241.160138:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+31:14531:x1875464002070528:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788582241.160181:0:14421:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788582241.160852:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+31:14531:x1875464002070528:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 Request processed in 712us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582241.160862:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 46 00000100:00100000:0.0:1788582241.168788:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582241.169051:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002070656 00000100:00100000:1.0:1788582241.169062:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002070656 00000100:00100000:1.0:1788582241.169176:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 47 00000100:00100000:1.0:1788582241.169187:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+31:14531:x1875464002070656:12345-192.168.201.12@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788582241.169472:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81a00/0x2bc3aa892c3a821a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.169491:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81a00/0x2bc3aa892c3a821a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.169733:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81a00/0x2bc3aa892c3a821a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.169770:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81000/0x2bc3aa892c3a8221 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.169777:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81000/0x2bc3aa892c3a8221 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.169785:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81000/0x2bc3aa892c3a8221 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.169807:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80e00/0x2bc3aa892c3a8228 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.169815:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80e00/0x2bc3aa892c3a8228 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.169822:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80e00/0x2bc3aa892c3a8228 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788582241.169857:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788582241.169861:0:14422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788582241.169875:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80e00/0x2bc3aa892c3a8228 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.169884:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81a00/0x2bc3aa892c3a821a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.169891:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81a00/0x2bc3aa892c3a821a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.169907:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81a00/0x2bc3aa892c3a821a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.169925:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0c81a81a00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582241.169930:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81a00/0x2bc3aa892c3a821a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.170247:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81a00/0x2bc3aa892c3a821a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.170263:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d0d85afc400) 00010000:00010000:1.0:1788582241.170267:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582241.170271:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81a00/0x2bc3aa892c3a821a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.170278:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81a00/0x2bc3aa892c3a821a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.170832:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81000/0x2bc3aa892c3a8221 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.170842:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81000/0x2bc3aa892c3a8221 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.170849:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81000/0x2bc3aa892c3a8221 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.170856:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0c81a81000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582241.170859:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81000/0x2bc3aa892c3a8221 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.170881:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81000/0x2bc3aa892c3a8221 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.170891:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff8d0d9188b800) 00010000:00010000:1.0:1788582241.170893:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582241.170898:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81000/0x2bc3aa892c3a8221 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.170904:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81000/0x2bc3aa892c3a8221 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.170934:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80e00/0x2bc3aa892c3a8228 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.171043:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80e00/0x2bc3aa892c3a8228 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.171050:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80e00/0x2bc3aa892c3a8228 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.171056:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0c81a80e00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:1.0:1788582241.171058:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80e00/0x2bc3aa892c3a8228 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.171065:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80e00/0x2bc3aa892c3a8228 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.171073:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9188b200) 00010000:00010000:1.0:1788582241.171076:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788582241.171079:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80e00/0x2bc3aa892c3a8228 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.171155:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80e00/0x2bc3aa892c3a8228 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582241.171458:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+31:14531:x1875464002070656:12345-192.168.201.12@tcp:34:lhsmtool_posix.0 Request processed in 2267us (2674us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582241.171468:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 47 00000100:00100000:3.0:1788582241.177146:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582241.177702:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002070912 00000100:00100000:2.0:1788582241.177714:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002070912 00000100:00100000:2.0:1788582241.177818:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 48 00000100:00100000:2.0:1788582241.177828:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+31:14531:x1875464002070912:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788582241.177849:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582241.177869:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a822f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9618 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.177984:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a8236 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.177999:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a8236 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.178010:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a8236 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582241.178021:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788582241.178125:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a8236 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.178132:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a8236 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.178155:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a8236 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.178161:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe04400 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:2.0:1788582241.178165:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a8236 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.178176:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a8236 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.178189:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9188b200) 00010000:00010000:2.0:1788582241.178192:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788582241.178197:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a8236 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.178231:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a8236 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.178273:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a822f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9618 expref: 33 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.178293:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d0d85afc400) 00010000:00010000:2.0:1788582241.178296:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788582241.178300:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a822f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9618 expref: 33 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.178452:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04600, rc 0) 00000100:00100000:2.0:1788582241.178698:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf431180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+32:14531:x1875464002070912:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 870us (1570us total) trans 8589934619 rc 301/301 00000100:00100000:2.0:1788582241.178718:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 48 00000100:00100000:0.0:1788582241.182111:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582241.182335:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002071040 00000100:00100000:1.0:1788582241.182346:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002071040 00000100:00100000:1.0:1788582241.182405:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 49 00000100:00100000:1.0:1788582241.182417:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+32:14531:x1875464002071040:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788582241.182456:0:14422:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788582241.182579:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+32:14531:x1875464002071040:12345-192.168.201.12@tcp:53:lhsmtool_posix.0 Request processed in 163us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582241.182586:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 49 00000100:00100000:1.0:1788582241.191754:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582241.192124:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002071296 00000100:00100000:2.0:1788582241.192136:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002071296 00000100:00100000:2.0:1788582241.192199:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 50 00000100:00100000:2.0:1788582241.192250:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+32:14531:x1875464002071296:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788582241.192278:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582241.192302:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a8244 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c961f expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788582241.193301:0:14420:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:2.0:1788582241.194003:0:14420:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:2.0:1788582241.194072:0:14420:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1788582241.195428:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a824b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.195449:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a824b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.195460:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a824b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.195687:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a8244 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c961f expref: 35 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.195707:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a824b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c961f expref: 34 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.195818:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d0d85afca00) 00010000:00010000:2.0:1788582241.195831:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788582241.195834:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04400, rc 0) 00000100:00100000:2.0:1788582241.195953:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+34:14531:x1875464002071296:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 3706us (4207us total) trans 8589934620 rc 0/0 00000100:00100000:2.0:1788582241.195963:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 50 00000100:00100000:3.0:1788582241.203156:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582241.203512:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002071552 00000100:00100000:0.0:1788582241.203671:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002071552 00000100:00100000:0.0:1788582241.203773:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 51 00000100:00100000:0.0:1788582241.203783:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dbf431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+34:14531:x1875464002071552:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788582241.203844:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582241.203875:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04400/0x2bc3aa892c3a824b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c961f expref: 34 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.203898:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d0d85afca00) 00010000:00010000:0.0:1788582241.203908:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788582241.203932:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2a00/0x2bc3aa892c3a8259 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.203957:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2a00/0x2bc3aa892c3a8259 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.203967:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2a00/0x2bc3aa892c3a8259 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.204014:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8260 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3e68311e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.204021:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8260 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3e68311e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.204028:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8260 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3e68311e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.204085:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2a00/0x2bc3aa892c3a8259 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.204115:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2a00/0x2bc3aa892c3a8259 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.204122:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2a00/0x2bc3aa892c3a8259 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.204128:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2a00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582241.204133:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2a00/0x2bc3aa892c3a8259 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.204140:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2a00/0x2bc3aa892c3a8259 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.204149:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d0d9450d000) 00010000:00010000:0.0:1788582241.204151:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582241.204155:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2a00/0x2bc3aa892c3a8259 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.204161:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2a00/0x2bc3aa892c3a8259 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.204170:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8260 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3e68311e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.204177:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8260 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3e68311e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.204183:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8260 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3e68311e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.204187:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e3800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582241.204194:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8260 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3e68311e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.204249:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8260 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x3e68311e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.204259:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x3e68311e (ffff8d0d9450d700) 00010000:00010000:0.0:1788582241.204261:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582241.204265:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8260 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3e68311e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.204271:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a8260 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x3e68311e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582241.204943:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dbf431f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+33:14531:x1875464002071552:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 Request processed in 1147us (1782us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788582241.204952:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 51 00000100:00100000:0.0:1788582241.210122:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582241.218848:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002071680 00000100:00100000:2.0:1788582241.218863:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002071680 00000100:00100000:2.0:1788582241.218935:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 52 00000100:00100000:2.0:1788582241.218946:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+33:14531:x1875464002071680:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788582241.218967:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582241.218993:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a8267 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9626 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.219029:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05600/0x2bc3aa892c3a826e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.219042:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05600/0x2bc3aa892c3a826e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.219054:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05600/0x2bc3aa892c3a826e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.219493:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04600/0x2bc3aa892c3a8267 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9626 expref: 35 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.219951:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05600/0x2bc3aa892c3a826e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9626 expref: 34 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.219961:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d0d85afc800) 00010000:00010000:2.0:1788582241.219972:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788582241.219976:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05600, rc 0) 00000100:00100000:2.0:1788582241.220037:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+34:14531:x1875464002071680:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 1093us (9928us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582241.220044:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 52 00000100:00100000:1.0:1788582241.238044:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582241.246833:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002071936 00000100:00100000:2.0:1788582241.246850:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002071936 00000100:00100000:3.0:1788582241.247019:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 53 00000100:00100000:3.0:1788582241.247032:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+34:14531:x1875464002071936:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788582241.247123:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e000/0x2bc3aa892c3a8275 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.247142:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e000/0x2bc3aa892c3a8275 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.247154:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e000/0x2bc3aa892c3a8275 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788582241.247610:0:14421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1788582241.247621:0:14421:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 460241418138ns, next at 461241415723ns, rc = 0 00000004:00010000:3.0:1788582241.247717:0:14421:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ead492ed reply state 000000009002b666 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e000/0x2bc3aa892c3a8275 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582241.247728:0:14421:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788582241.247865:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+36:14531:x1875464002071936:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 Request processed in 834us (9838us total) trans 8589934621 rc 0/0 00000100:00100000:3.0:1788582241.247872:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 53 00010000:00010000:0.0:1788582241.251288:0:3292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e000/0x2bc3aa892c3a8275 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.251309:0:3292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e000/0x2bc3aa892c3a8275 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.251317:0:3292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e000/0x2bc3aa892c3a8275 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.251376:0:3292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8138e000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582241.251382:0:3292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e000/0x2bc3aa892c3a8275 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.251390:0:3292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e000/0x2bc3aa892c3a8275 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.251422:0:3292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d0d85afc800) 00010000:00010000:0.0:1788582241.251425:0:3292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788582241.251430:0:3292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e000/0x2bc3aa892c3a8275 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.251437:0:3292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e000/0x2bc3aa892c3a8275 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582241.255725:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582241.255851:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002072064 00000100:00100000:3.0:1788582241.255863:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002072064 00000100:00100000:3.0:1788582241.255949:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 54 00000100:00100000:3.0:1788582241.255961:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+35:14531:x1875464002072064:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788582241.255985:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582241.256006:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e400/0x2bc3aa892c3a827c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c962d expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.256124:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e400/0x2bc3aa892c3a827c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c962d expref: 36 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.256142:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e400/0x2bc3aa892c3a827c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c962d expref: 36 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.256164:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d0d85afc800) 00010000:00010000:3.0:1788582241.256167:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788582241.256171:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8138e400, rc 0) 00000100:00100000:3.0:1788582241.256280:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+36:14531:x1875464002072064:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 321us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582241.256289:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 54 00000100:00100000:3.0:1788582241.271902:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582241.272053:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002072192 00000100:00100000:1.0:1788582241.272063:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002072192 00000100:00100000:1.0:1788582241.272260:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 12 00000100:00100000:1.0:1788582241.272271:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+5:2350:x1875464002072192:12345-192.168.201.12@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788582241.272657:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:2350:x1875464002072192:12345-192.168.201.12@tcp:2:lhsmtool_posix.0 Request processed in 386us (764us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788582241.272665:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 12 00000100:00100000:1.0:1788582241.281080:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582241.281622:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002072448 00000100:00100000:3.0:1788582241.281637:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002072448 00000100:00100000:3.0:1788582241.281698:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 11 00000100:00100000:3.0:1788582241.281709:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+36:14531:x1875464002072448:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788582241.282066:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+37:14531:x1875464002072448:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 Request processed in 358us (997us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1788582241.282075:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 11 00000100:00100000:0.0:1788582241.293797:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582241.293894:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002072704 00000100:00100000:2.0:1788582241.293904:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002072704 00000100:00100000:2.0:1788582241.293964:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 55 00000100:00100000:2.0:1788582241.293974:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+37:14531:x1875464002072704:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788582241.294089:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+37:14531:x1875464002072704:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 Request processed in 116us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582241.294097:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 55 00000100:00100000:0.0:1788582241.302675:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582241.305228:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002072832 00000100:00100000:3.0:1788582241.305243:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002072832 00000100:00100000:3.0:1788582241.305308:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 56 00000100:00100000:3.0:1788582241.305336:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+37:14531:x1875464002072832:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788582241.305359:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788582241.305381:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e600/0x2bc3aa892c3a8283 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9634 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.306146:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f200/0x2bc3aa892c3a828a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.306164:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f200/0x2bc3aa892c3a828a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.306176:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f200/0x2bc3aa892c3a828a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788582241.306245:0:14422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788582241.306267:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f200/0x2bc3aa892c3a828a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.306298:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e600/0x2bc3aa892c3a8283 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9634 expref: 39 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.306317:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f200/0x2bc3aa892c3a828a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9634 expref: 38 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.306355:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d0d85afc800) 00010000:00010000:3.0:1788582241.306358:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788582241.306361:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d8138f200, rc 0) 00000100:00100000:3.0:1788582241.306668:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+38:14531:x1875464002072832:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 1348us (4006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582241.306676:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 56 00000100:00100000:1.0:1788582241.312760:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582241.312868:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002072960 00000100:00100000:2.0:1788582241.312881:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002072960 00000100:00100000:2.0:1788582241.312955:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 13 00000100:00100000:2.0:1788582241.312968:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:2350:x1875464002072960:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788582241.312988:0:16294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582241.313010:0:16294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a8291 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c963b expref: -99 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788582241.313039:0:16294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9b9960, blocks: 0x1 00010000:00010000:2.0:1788582241.313059:0:16294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=460s v=(0 0) 00010000:00010000:2.0:1788582241.313064:0:16294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788582241.313075:0:16294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a8291 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c963b expref: 7 pid: 16294 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.313128:0:16294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a8291 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c963b expref: 7 pid: 16294 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.313142:0:16294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04600, rc 0) 00000100:00100000:2.0:1788582241.313246:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3db2c11a-8b82-4246-9cf9-9575f62f5233+7:2350:x1875464002072960:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 279us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582241.313253:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 13 00000100:00100000:0.0:1788582241.319400:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582241.319580:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002073216 00000100:00100000:2.0:1788582241.319593:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002073216 00000100:00100000:2.0:1788582241.319663:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 57 00000100:00100000:2.0:1788582241.319675:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+38:14531:x1875464002073216:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788582241.319852:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+38:14531:x1875464002073216:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 Request processed in 178us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582241.319860:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 57 00000100:00100000:3.0:1788582241.329806:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582241.329927:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002073344 00000100:00100000:0.0:1788582241.329939:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002073344 00000100:00100000:0.0:1788582241.330013:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 58 00000100:00100000:0.0:1788582241.330024:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+38:14531:x1875464002073344:12345-192.168.201.12@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788582241.431809:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:2.0:1788582241.431833:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:2.0:1788582241.432023:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934618 is committed 00000001:00080000:2.0:1788582241.432034:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000001:00080000:2.0:1788582241.432050:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000001:00080000:2.0:1788582241.432060:0:5866:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:2.0:1788582241.432066:0:5866:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788582241.432376:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c813a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020922880:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788582241.432457:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582241.432665:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+13:14531:x1875464002073344:12345-192.168.201.12@tcp:44:lhsmtool_posix.0 Request processed in 102639us (102869us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582241.432675:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 58 00000100:00100000:0.0:1788582241.441126:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020922880 00000100:00100000:0.0:1788582241.441147:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020922880 00000100:00100000:0.0:1788582241.444070:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788582241.444088:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020922880:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788582241.444293:0:15107:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788582241.444297:0:15107:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788582241.444299:0:15107:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788582241.444301:0:15107:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788582240 -> 1788582240 00002000:00010000:0.0:1788582241.444303:0:15107:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788582241.444388:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d13480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1875464020922880:12345-0@lo:2:osp-syn-1-0.0 Request processed in 306us (11930us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788582241.444396:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1788582241.447267:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d0c813a0a80/2, rc 0, transno 8589934595 00000100:00100000:2.0:1788582241.447308:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c813a0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020922880:0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1788582241.448724:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788582241.450769:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582241.451803:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002073472 00000100:00100000:3.0:1788582241.451816:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002073472 00000100:00100000:3.0:1788582241.451898:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 15 00000100:00100000:3.0:1788582241.451912:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3db2c11a-8b82-4246-9cf9-9575f62f5233+7:2352:x1875464002073472:12345-192.168.201.12@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788582241.452047:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3db2c11a-8b82-4246-9cf9-9575f62f5233+7:2352:x1875464002073472:12345-192.168.201.12@tcp:16:lhsmtool_posix.0 Request processed in 139us (1290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582241.452055:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 15 00000100:00100000:1.0:1788582241.462730:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582241.462827:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002073728 00000100:00100000:0.0:1788582241.462839:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002073728 00000100:00100000:0.0:1788582241.462915:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 59 00000100:00100000:0.0:1788582241.462926:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+13:14531:x1875464002073728:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788582241.462984:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788582241.463011:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138f200/0x2bc3aa892c3a828a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9634 expref: 13 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.463034:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d0d85afc800) 00010000:00010000:0.0:1788582241.463040:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788582241.463077:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8298 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.463091:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8298 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.463102:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8298 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788582241.463439:0:14421:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dd9e059c reply state 00000000f6a2d96e transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8298 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582241.463449:0:14421:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788582241.463561:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+14:14531:x1875464002073728:12345-192.168.201.12@tcp:36:lhsmtool_posix.0 Request processed in 635us (841us total) trans 8589934623 rc 0/0 00000100:00100000:0.0:1788582241.463568:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 59 00000100:00100000:1.0:1788582241.467751:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00010000:00010000:3.0:1788582241.467920:0:3293:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8298 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.467933:0:3293:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8298 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.467940:0:3293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8298 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.467963:0:3293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2000 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:3.0:1788582241.467968:0:3293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8298 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.467976:0:3293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8298 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.467994:0:3293:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d0d85afc800) 00010000:00010000:3.0:1788582241.467997:0:3293:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788582241.468002:0:3293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8298 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.468007:0:3293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2000/0x2bc3aa892c3a8298 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582241.468347:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002073856 00000100:00100000:2.0:1788582241.468358:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002073856 00000100:00100000:2.0:1788582241.468402:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 16 00000100:00100000:2.0:1788582241.468413:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+7:14531:x1875464002073856:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788582241.468431:0:15107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582241.468447:0:15107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0acaa14/0x2bc3aa892c3a829f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9642 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.468475:0:15107:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a8291 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c963b expref: 8 pid: 16294 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.468484:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788582241.468489:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788582241.468504:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0acaa14/0x2bc3aa892c3a829f lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9642 expref: 8 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.468542:0:15107:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a8291 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c963b expref: 8 pid: 16294 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.468556:0:15107:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a8291 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c963b expref: 8 pid: 16294 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582241.468571:0:15107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d90d12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15107:1875464020923008:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582241.468661:0:15107:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0dab9c2240 going to sleep for 11 seconds 00000100:00100000:2.0:1788582241.470168:0:15107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d90d12a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:15107:1875464020923008:192.168.201.12@tcp:104: 00010000:00010000:2.0:1788582241.470195:0:15107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b0acaa14/0x2bc3aa892c3a829f lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9642 expref: 8 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582241.470543:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582241.470609:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002073984 00000100:00100000:3.0:1788582241.470617:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002073984 00010000:00010000:3.0:1788582241.470650:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a8291 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c963b expref: 9 pid: 16294 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582241.470694:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 14 00000100:00100000:3.0:1788582241.470703:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+9:2349:x1875464002073984:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582241.470716:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582241.470739:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a8291 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c963b expref: 9 pid: 16294 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.470753:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a8291 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c963b expref: 9 pid: 16294 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.470793:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f16c6d3/0x2bc3aa892c3a8291 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c963b expref: 9 pid: 16294 timeout: 560 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.470809:0:14406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582241.470812:0:14406:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788582241.470819:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0acaa14/0x2bc3aa892c3a829f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9642 expref: 8 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.470829:0:14406:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0acaa14/0x2bc3aa892c3a829f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9642 expref: 8 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.470856:0:14406:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b0acaa14/0x2bc3aa892c3a829f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9642 expref: 8 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582241.470868:0:14406:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dac0c3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14406:1875464020923136:192.168.201.12@tcp:105: 00000100:00100000:3.0:1788582241.470935:0:14406:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da7194900 going to sleep for 11 seconds 00010000:00010000:2.0:1788582241.471229:0:15107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe05400, rc 0) 00000100:00100000:2.0:1788582241.471260:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+8:14531:x1875464002073856:12345-192.168.201.12@tcp:101:lhsmtool_posix.0 Request processed in 2849us (3519us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582241.471268:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 16 00000100:00100000:3.0:1788582241.472931:0:14406:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dac0c3480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14406:1875464020923136:192.168.201.12@tcp:105: 00010000:00010000:3.0:1788582241.472951:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582241.473000:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+7:2349:x1875464002073984:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 2297us (2457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582241.473011:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 14 00000100:00100000:3.0:1788582241.474265:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582241.474384:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002074112 00000100:00100000:0.0:1788582241.474396:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002074112 00000100:00100000:0.0:1788582241.474455:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 17 00000100:00100000:0.0:1788582241.474465:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dac0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3db2c11a-8b82-4246-9cf9-9575f62f5233+7:2352:x1875464002074112:12345-192.168.201.12@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788582241.474704:0:16294:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788582241.474708:0:16294:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788582239 00002000:00010000:0.0:1788582241.474711:0:16294:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788582238 00002000:00010000:0.0:1788582241.474713:0:16294:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1788582240 -> 1788582239 00002000:00010000:0.0:1788582241.474715:0:16294:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788582241.474771:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dac0c3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3db2c11a-8b82-4246-9cf9-9575f62f5233+8:2352:x1875464002074112:12345-192.168.201.12@tcp:2:lhsmtool_posix.0 Request processed in 306us (511us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1788582241.474778:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 17 00000100:00100000:1.0:1788582241.478005:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582241.480434:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002074240 00000100:00100000:0.0:1788582241.480449:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002074240 00000100:00100000:0.0:1788582241.480530:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 18 00000100:00100000:0.0:1788582241.480543:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+8:2351:x1875464002074240:12345-192.168.201.12@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788582241.480596:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000578fc0c8/0x2bc3aa892c3a82a6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.480634:0:15104:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b0acaa14/0x2bc3aa892c3a829f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9642 expref: 8 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.480644:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582241.480648:0:15104:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788582241.480653:0:15104:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000578fc0c8/0x2bc3aa892c3a82a6 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.480688:0:15104:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b0acaa14/0x2bc3aa892c3a829f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9642 expref: 8 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.480727:0:15104:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b0acaa14/0x2bc3aa892c3a829f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9642 expref: 8 pid: 15107 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582241.480742:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c813a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15104:1875464020923264:192.168.201.12@tcp:104: 00000100:00100000:0.0:1788582241.480840:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d857e9540 going to sleep for 11 seconds 00000100:00100000:0.0:1788582241.485457:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c813a2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:15104:1875464020923264:192.168.201.12@tcp:104: 00010000:00010000:0.0:1788582241.485504:0:15104:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000578fc0c8/0x2bc3aa892c3a82a6 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582241.486574:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582241.486751:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002074368 00000100:00100000:3.0:1788582241.486761:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002074368 00010000:00010000:3.0:1788582241.486809:0:14405:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b0acaa14/0x2bc3aa892c3a829f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9642 expref: 9 pid: 15107 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582241.486851:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 15 00000100:00100000:3.0:1788582241.486861:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+9:2349:x1875464002074368:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788582241.486874:0:14405:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788582241.486894:0:14405:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b0acaa14/0x2bc3aa892c3a829f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9642 expref: 9 pid: 15107 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.486908:0:14405:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b0acaa14/0x2bc3aa892c3a829f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9642 expref: 9 pid: 15107 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.486931:0:14405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0acaa14/0x2bc3aa892c3a829f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9642 expref: 9 pid: 15107 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.486946:0:14405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788582241.486951:0:14405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788582241.486956:0:14405:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000578fc0c8/0x2bc3aa892c3a82a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.486967:0:14405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000578fc0c8/0x2bc3aa892c3a82a6 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.487038:0:14405:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788582241.487098:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd94000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+8:2349:x1875464002074368:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 238us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582241.487114:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 15 00010000:00010000:1.0:1788582241.494866:0:15104:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000578fc0c8/0x2bc3aa892c3a82a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.494887:0:15104:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000578fc0c8/0x2bc3aa892c3a82a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.494925:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000578fc0c8/0x2bc3aa892c3a82a6 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.494934:0:15104:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000578fc0c8/0x2bc3aa892c3a82a6 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.494942:0:15104:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000578fc0c8/0x2bc3aa892c3a82a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.494948:0:15104:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2a00 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582241.494953:0:15104:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000578fc0c8/0x2bc3aa892c3a82a6 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.494961:0:15104:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000578fc0c8/0x2bc3aa892c3a82a6 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.494999:0:15104:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000578fc0c8/0x2bc3aa892c3a82a6 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.495006:0:15104:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000578fc0c8/0x2bc3aa892c3a82a6 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788582241.495119:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+7:2351:x1875464002074240:12345-192.168.201.12@tcp:1:lhsmtool_posix.0 Request processed in 14573us (17121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582241.495129:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 18 00000100:00100000:1.0:1788582241.505457:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582241.505532:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002074624 00000100:00100000:3.0:1788582241.505544:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002074624 00000100:00100000:3.0:1788582241.505605:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 60 00000100:00100000:3.0:1788582241.505617:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+13:14531:x1875464002074624:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788582241.505715:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138ea00/0x2bc3aa892c3a82ad lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.505733:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138ea00/0x2bc3aa892c3a82ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.505746:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138ea00/0x2bc3aa892c3a82ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.506049:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e600/0x2bc3aa892c3a82b4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.506061:0:14422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e400/0x2bc3aa892c3a827c lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c962d expref: 14 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.506070:0:14422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e600/0x2bc3aa892c3a82b4 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.506107:0:14422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e400/0x2bc3aa892c3a827c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c962d expref: 14 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788582241.506120:0:14422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e400/0x2bc3aa892c3a827c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c962d expref: 14 pid: 14422 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788582241.506147:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b37100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14422:1875464020923392:192.168.201.12@tcp:104: 00000100:00100000:3.0:1788582241.506269:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0da7194900 going to sleep for 11 seconds 00000100:00100000:1.0:1788582241.520405:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582241.520538:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b37100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14422:1875464020923392:192.168.201.12@tcp:104: 00000100:00100000:2.0:1788582241.520541:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002074752 00000100:00100000:2.0:1788582241.520550:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002074752 00010000:00010000:3.0:1788582241.520568:0:14422:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e600/0x2bc3aa892c3a82b4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.520594:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e400/0x2bc3aa892c3a827c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c962d expref: 15 pid: 14422 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788582241.520638:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 16 00000100:00100000:2.0:1788582241.520648:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+15:2350:x1875464002074752:12345-192.168.201.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788582241.520664:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788582241.520671:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e400/0x2bc3aa892c3a827c lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c962d expref: 15 pid: 14422 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.520686:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e400/0x2bc3aa892c3a827c lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c962d expref: 15 pid: 14422 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.520707:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e400/0x2bc3aa892c3a827c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c962d expref: 15 pid: 14422 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.520724:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d0d85afc800) 00010000:00010000:2.0:1788582241.520743:0:14406:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e600/0x2bc3aa892c3a82b4 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.520764:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e600/0x2bc3aa892c3a82b4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.520772:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e600/0x2bc3aa892c3a82b4 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.520800:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788582241.520858:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+14:2350:x1875464002074752:12345-192.168.201.12@tcp:103:ldlm_bl.0 Request processed in 210us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582241.520865:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 16 00010000:00010000:0.0:1788582241.520974:0:14422:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e600/0x2bc3aa892c3a82b4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.520982:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e600/0x2bc3aa892c3a82b4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788582241.521165:0:14422:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1788582241.521359:0:14422:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:0.0:1788582241.521404:0:14422:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:0.0:1788582241.521485:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c813a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14422:1875464020923520:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788582241.521581:0:14422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582241.521609:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8a934300 going to sleep for 11 seconds 00000100:00100000:2.0:1788582241.522120:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020923520 00000100:00100000:2.0:1788582241.522126:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020923520 00000100:00100000:2.0:1788582241.522167:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788582241.522175:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14422:x1875464020923520:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788582241.522279:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14422:x1875464020923520:12345-0@lo:1000:mdt00_002.0 Request processed in 104us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582241.522286:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788582241.522523:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c813a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14422:1875464020923520:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788582241.524110:0:14422:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:0.0:1788582241.524263:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c813a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14422:1875464020923648:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788582241.524371:0:14422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582241.524412:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8a934180 going to sleep for 11 seconds 00000100:00100000:2.0:1788582241.526896:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020923648 00000100:00100000:2.0:1788582241.526911:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020923648 00000100:00100000:2.0:1788582241.526978:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788582241.526988:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14422:x1875464020923648:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788582241.527248:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14422:x1875464020923648:12345-0@lo:1000:mdt00_002.0 Request processed in 261us (2877us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1788582241.527257:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788582241.527782:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c813a2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14422:1875464020923648:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788582241.527825:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e600/0x2bc3aa892c3a82b4 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.527836:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e600/0x2bc3aa892c3a82b4 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.527845:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e600/0x2bc3aa892c3a82b4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.527851:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8138e600 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582241.527855:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e600/0x2bc3aa892c3a82b4 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.527863:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e600/0x2bc3aa892c3a82b4 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.527878:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d0d85afc800) 00010000:00010000:0.0:1788582241.527881:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788582241.527886:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e600/0x2bc3aa892c3a82b4 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.527891:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138e600/0x2bc3aa892c3a82b4 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.527926:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81e00/0x2bc3aa892c3a820c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.527933:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81e00/0x2bc3aa892c3a820c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.527940:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81e00/0x2bc3aa892c3a820c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.527961:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0c81a81e00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582241.527965:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81e00/0x2bc3aa892c3a820c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.527971:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81e00/0x2bc3aa892c3a820c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.527980:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9188b200) 00010000:00010000:0.0:1788582241.527982:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788582241.527990:0:14422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80600/0x2bc3aa892c3a8213 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9611 expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.528003:0:14422:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80600/0x2bc3aa892c3a8213 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9611 expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.528014:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80600/0x2bc3aa892c3a8213 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9611 expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.528047:0:14422:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a80600/0x2bc3aa892c3a8213 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9611 expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582241.528060:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c813a0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14422:1875464020923776:192.168.201.12@tcp:105: 00000100:00100000:0.0:1788582241.528139:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff8d0d8a934180 going to sleep for 11 seconds 00000100:00100000:1.0:1788582241.532464:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582241.532828:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c813a0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14422:1875464020923776:192.168.201.12@tcp:105: 00010000:00010000:0.0:1788582241.532854:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81e00/0x2bc3aa892c3a820c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.532882:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0c81a81e00/0x2bc3aa892c3a820c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.532923:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a82bb lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.532938:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a82bb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.532949:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a82bb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.532960:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a82bb lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.532967:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a82bb lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.532974:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a82bb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.532979:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e3800 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582241.532983:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a82bb lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.532990:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a82bb lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.533000:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9188b200) 00010000:00010000:0.0:1788582241.533003:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582241.533006:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a82bb lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.533016:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3800/0x2bc3aa892c3a82bb lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.533026:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138ea00/0x2bc3aa892c3a82ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.533031:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138ea00/0x2bc3aa892c3a82ad lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.533037:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138ea00/0x2bc3aa892c3a82ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.533043:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d8138ea00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582241.533045:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138ea00/0x2bc3aa892c3a82ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.533051:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138ea00/0x2bc3aa892c3a82ad lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.533057:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9188b200) 00010000:00010000:0.0:1788582241.533060:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788582241.533062:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138ea00/0x2bc3aa892c3a82ad lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.533068:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d8138ea00/0x2bc3aa892c3a82ad lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788582241.533386:0:14451:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788582241.533391:0:14451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788582241.533417:0:14451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1788582241.533422:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788582241.533789:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+17:14531:x1875464002074624:12345-192.168.201.12@tcp:57:lhsmtool_posix.0 Request processed in 28171us (28346us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1788582241.533799:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 60 00000020:00080000:0.0:1788582241.533804:0:14422:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788582241.534608:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002074880 00000100:00100000:2.0:1788582241.534617:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002074880 00000100:00100000:2.0:1788582241.534718:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 12 00000100:00100000:2.0:1788582241.534728:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d9dd95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+17:14530:x1875464002074880:12345-192.168.201.12@tcp:49:bash.0 00000100:00100000:2.0:1788582241.534868:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d9dd95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+17:14530:x1875464002074880:12345-192.168.201.12@tcp:49:bash.0 Request processed in 141us (2414us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582241.534874:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 12 00000100:00100000:1.0:1788582241.554030:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582241.554079:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582241.554174:0:16294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002075008 00000100:00100000:3.0:1788582241.554181:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002075264 00000100:00100000:3.0:1788582241.554185:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002075264 00000100:00100000:0.0:1788582241.554185:0:16294:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002075008 00000100:00100000:0.0:1788582241.554276:0:16294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 19 00000100:00100000:0.0:1788582241.554288:0:16294:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7722680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3db2c11a-8b82-4246-9cf9-9575f62f5233+7:14530:x1875464002075008:12345-192.168.201.12@tcp:101:bash.0 00010000:00010000:0.0:1788582241.554305:0:16294:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788582241.554329:0:16294:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d449b96e/0x2bc3aa892c3a82c2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9649 expref: -99 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788582241.554359:0:16294:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a9b995f, atime: 0x6a9b995e, ctime: 0x6a9b995f, blocks: 0x1 00010000:00010000:0.0:1788582241.554392:0:16294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=460s v=(0 0) 00010000:00010000:0.0:1788582241.554397:0:16294:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788582241.554407:0:16294:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d449b96e/0x2bc3aa892c3a82c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9649 expref: 8 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.554425:0:16294:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d449b96e/0x2bc3aa892c3a82c2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9649 expref: 8 pid: 16294 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.554439:0:16294:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0d9d8e3800, rc 0) 00000100:00100000:0.0:1788582241.554507:0:16294:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7722680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3db2c11a-8b82-4246-9cf9-9575f62f5233+8:14530:x1875464002075008:12345-192.168.201.12@tcp:101:bash.0 Request processed in 220us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582241.554514:0:16294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 19 00000100:00100000:2.0:1788582241.554533:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 13 00000100:00100000:2.0:1788582241.554542:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+17:14531:x1875464002075264:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788582241.555680:0:14423:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788582241.555843:0:14423:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:2.0:1788582241.555890:0:14423:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a82c9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.555906:0:14423:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a82c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.555917:0:14423:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a82c9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.555926:0:14423:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a82c9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.555933:0:14423:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a82c9 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.555939:0:14423:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a82c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.555963:0:14423:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788582241.556055:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7721c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+19:14531:x1875464002075264:12345-192.168.201.12@tcp:35:lhsmtool_posix.0 Request processed in 1512us (1972us total) trans 8589934630 rc 0/0 00000100:00100000:2.0:1788582241.556072:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 13 00000020:00080000:2.0:1788582241.556077:0:14423:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788582241.558317:0:14408:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788582241.558331:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a82c9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.558341:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0dbbe05400 already unused, calling callback (ffffffffc16ea230) 00010000:00010000:1.0:1788582241.558345:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a82c9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.558351:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a82c9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.558374:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d0d85afc800) 00010000:00010000:1.0:1788582241.558376:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788582241.558392:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a82c9 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.558396:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe05400/0x2bc3aa892c3a82c9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14423 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788582241.558408:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582241.558409:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788582241.558410:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582241.562606:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582241.562862:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002075520 00000100:00100000:3.0:1788582241.562889:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002075520 00000100:00100000:3.0:1788582241.562949:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 14 00000100:00100000:3.0:1788582241.562959:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+19:14530:x1875464002075520:12345-192.168.201.12@tcp:35:bash.0 00000001:00080000:3.0:1788582241.563251:0:14424:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:3.0:1788582241.563369:0:14424:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:3.0:1788582241.563481:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7723b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+22:14530:x1875464002075520:12345-192.168.201.12@tcp:35:bash.0 Request processed in 523us (885us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1788582241.563490:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 14 00000020:00080000:3.0:1788582241.563506:0:14424:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1788582241.729665:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:2.0:1788582241.729776:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002075776 00000100:00100000:2.0:1788582241.729787:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002075776 00000100:00100000:2.0:1788582241.729853:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 61 00000100:00100000:2.0:1788582241.729863:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0c813a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+22:14541:x1875464002075776:12345-192.168.201.12@tcp:101:lfs.0 00010000:00010000:2.0:1788582241.730046:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788582241.730067:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a82d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdc14f0f74e3c9650 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788582241.730158:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788582241.730312:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a82d0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9650 expref: 24 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.730328:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d0d9450d200) 00010000:00010000:2.0:1788582241.730332:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788582241.730337:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0dbbe04800/0x2bc3aa892c3a82d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.12@tcp remote: 0xdc14f0f74e3c9650 expref: 24 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788582241.730351:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d0dbbe04800, rc 0) 00000100:00100000:2.0:1788582241.730415:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0c813a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+23:14541:x1875464002075776:12345-192.168.201.12@tcp:101:lfs.0 Request processed in 552us (760us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1788582241.730423:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 61 00000100:00100000:1.0:1788582241.733404:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582241.733509:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002075904 00000100:00100000:0.0:1788582241.733537:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002075904 00000100:00100000:0.0:1788582241.733603:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 62 00000100:00100000:0.0:1788582241.733613:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+23:14541:x1875464002075904:12345-192.168.201.12@tcp:34:lfs.0 00010000:00010000:0.0:1788582241.733705:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a82de lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.733722:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a82de lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.733733:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a82de lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.733749:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a82e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.733755:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a82e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.733761:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a82e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734021:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a82ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734030:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a82ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734038:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a82ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788582241.734075:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a82ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734099:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a82de lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734105:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a82de lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734113:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a82de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734118:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2600 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582241.734122:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a82de lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734129:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a82de lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734141:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d0d9450d000) 00010000:00010000:0.0:1788582241.734143:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582241.734148:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a82de lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734154:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2600/0x2bc3aa892c3a82de lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734166:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a82e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734172:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a82e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734177:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a82e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734188:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e3a00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582241.734191:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a82e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734197:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a82e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734247:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff8d0d9450dd00) 00010000:00010000:0.0:1788582241.734250:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582241.734253:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a82e5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734258:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e3a00/0x2bc3aa892c3a82e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734272:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a82ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734279:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a82ec lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734284:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a82ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734289:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d0d9d8e2e00 already unused, calling callback (ffffffffc212a4f0) 00010000:00010000:0.0:1788582241.734292:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a82ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734297:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a82ec lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734315:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d0d9188b200) 00010000:00010000:0.0:1788582241.734317:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788582241.734320:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a82ec lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788582241.734325:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d0d9d8e2e00/0x2bc3aa892c3a82ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788582241.734396:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7722d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+23:14541:x1875464002075904:12345-192.168.201.12@tcp:34:lfs.0 Request processed in 782us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582241.734404:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 62 00000100:00100000:1.0:1788582241.738417:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:3.0:1788582241.738634:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002076160 00000100:00100000:3.0:1788582241.738646:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002076160 00000100:00100000:3.0:1788582241.738719:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 15 00000100:00100000:3.0:1788582241.738731:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+23:14541:x1875464002076160:12345-192.168.201.12@tcp:35:lfs.0 00000100:00100000:3.0:1788582241.740238:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7720e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+24:14541:x1875464002076160:12345-192.168.201.12@tcp:35:lfs.0 Request processed in 1474us (1798us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1788582241.740250:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 15 00010000:00010000:0.0:1788582241.775487:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788582241.776069:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788582241.776091:0:3306:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c813a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020923904:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788582241.776163:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788582241.776473:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020923904 00000100:00100000:0.0:1788582241.776482:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020923904 00000100:00100000:0.0:1788582241.776561:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788582241.776571:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020923904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788582241.776608:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788582241.776653:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1875464020923904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582241.776661:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1788582241.782335:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788582241.782404:0:3306:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c813a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1875464020923904:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788582242.797491:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788582243.586151:0:14451:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788582243.586161:0:14451:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788582243.586192:0:14451:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788582243.586199:0:14451:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:02000400:0.0:1788582243.709118:0:16684:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:3.0:1788582243.822044:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582244.712866:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582244.712928:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582244.713158:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002076416 00000100:00100000:0.0:1788582244.713172:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002076416 00000100:00100000:0.0:1788582244.713294:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 20 00000100:00100000:0.0:1788582244.713308:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+8:2349:x1875464002076416:12345-192.168.201.12@tcp:16:kworker.0 00000100:00100000:0.0:1788582244.713489:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7722a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3db2c11a-8b82-4246-9cf9-9575f62f5233+8:2349:x1875464002076416:12345-192.168.201.12@tcp:16:kworker.0 Request processed in 185us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582244.713514:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 20 00000100:00100000:2.0:1788582244.713716:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002076288 00000100:00100000:2.0:1788582244.713723:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002076288 00002000:00100000:2.0:1788582244.713756:0:15110:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff8d0db7723480 x1875464002076288/t0(0) o4->3db2c11a-8b82-4246-9cf9-9575f62f5233@192.168.201.12@tcp:90/0 lens 504/0 e 0 to 0 dl 1788582255 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788582244.713768:0:15110:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0db7723480 with x1875464002076288 ext(0->8) 00002000:00010000:2.0:1788582244.713775:0:15110:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0db7723480 00000100:00100000:2.0:1788582244.713805:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 0 00000100:00100000:2.0:1788582244.713813:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+8:2349:x1875464002076288:12345-192.168.201.12@tcp:4:bash.0 00000100:00100000:2.0:1788582244.715098:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7723480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+10:2349:x1875464002076288:12345-192.168.201.12@tcp:4:bash.0 Request processed in 1277us (2240us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788582244.715111:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 0 00002000:00100000:2.0:1788582244.715123:0:15110:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x22:0x0] (0->8) req@ffff8d0db7723480 x1875464002076288/t8589934598(0) o4->3db2c11a-8b82-4246-9cf9-9575f62f5233@192.168.201.12@tcp:90/0 lens 504/448 e 0 to 0 dl 1788582255 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788582244.715134:0:15110:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff8d0db7723480 with x1875464002076288 ext(0->8) 00002000:00010000:2.0:1788582244.715140:0:15110:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff8d0db7723480 00000100:00080000:1.0:1788582244.715315:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788582244.845351:0:14408:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788582244.845749:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c813a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875464020924416:0@lo:400:kworker.0 00000100:00100000:1.0:1788582244.845820:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582244.845884:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788582244.845891:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c813a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020924288:0@lo:400:kworker.0 00000100:00100000:1.0:1788582244.845916:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788582244.845959:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020924416 00000100:00100000:1.0:1788582244.845969:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020924416 00000100:00100000:1.0:1788582244.846026:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788582244.846037:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875464020924416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788582244.846092:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7722300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1875464020924416:12345-0@lo:400:kworker.0 Request processed in 57us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582244.846099:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788582244.846134:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020924288 00000100:00100000:1.0:1788582244.846138:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020924288 00000100:00100000:1.0:1788582244.846179:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788582244.846187:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1875464020924288:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788582244.846231:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788582244.846243:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7721880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3307:x1875464020924288:12345-0@lo:400:kworker.0 Request processed in 56us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582244.846250:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788582244.846274:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c813a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020924288:0@lo:400:kworker.0 00000100:00100000:0.0:1788582244.846289:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c813a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3307:1875464020924416:0@lo:400:kworker.0 00000100:00100000:3.0:1788582244.846540:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c813a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9415e791-1a3c-4924-bcfc-d6d86718d620:3308:1875464020924032:0@lo:400:kworker.0 00000100:00100000:3.0:1788582244.846578:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582244.846605:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c813a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020924544:0@lo:400:kworker.0 00000100:00100000:3.0:1788582244.846629:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582244.846650:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788582244.846656:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0c813a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020924160:0@lo:400:kworker.0 00000100:00100000:3.0:1788582244.846679:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582244.846696:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0dbad08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020924672:0@lo:400:kworker.0 00000100:00100000:3.0:1788582244.846716:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582244.846784:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020924032 00000100:00100000:3.0:1788582244.846788:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020924032 00000100:00100000:3.0:1788582244.846817:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788582244.846838:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d90d47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+19:3308:x1875464020924032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582244.846873:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d90d47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9415e791-1a3c-4924-bcfc-d6d86718d620+19:3308:x1875464020924032:12345-0@lo:400:kworker.0 Request processed in 50us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582244.846880:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1788582244.846918:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020924544 00000100:00100000:3.0:1788582244.846922:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020924544 00000100:00100000:3.0:1788582244.846950:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020924672 00000100:00100000:3.0:1788582244.846953:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020924672 00000100:00100000:3.0:1788582244.846970:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788582244.846976:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020924544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582244.847017:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875464020924544:12345-0@lo:400:kworker.0 Request processed in 41us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582244.847023:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788582244.847035:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788582244.847040:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020924672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582244.847065:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875464020924672:12345-0@lo:400:kworker.0 Request processed in 26us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582244.847071:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788582244.847086:0:15104:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020924160 00000100:00100000:3.0:1788582244.847090:0:15104:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020924160 00000100:00100000:3.0:1788582244.847114:0:15104:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788582244.847120:0:15104:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020924160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788582244.847149:0:15104:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3308:x1875464020924160:12345-0@lo:400:kworker.0 Request processed in 29us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582244.847155:0:15104:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1788582244.847189:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788582244.847192:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788582244.847197:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788582244.847233:0:3307:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff8d0d85b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020924800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788582244.847259:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788582244.847284:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464020924800 00000100:00100000:3.0:1788582244.847287:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464020924800 00000100:00100000:3.0:1788582244.847310:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788582244.847317:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0d85b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875464020924800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788582244.847332:0:15108:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788582244.847365:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0d85b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3307:x1875464020924800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 49us (105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582244.847380:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788582244.847414:0:3307:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0d85b35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1875464020924800:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788582244.847447:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c813a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1875464020924160:0@lo:400:kworker.0 00000100:00100000:3.0:1788582244.847458:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0dbad08380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1875464020924672:0@lo:400:kworker.0 00000100:00100000:3.0:1788582244.847466:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c813a1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:9415e791-1a3c-4924-bcfc-d6d86718d620:3308:1875464020924032:0@lo:400:kworker.0 00000100:00100000:3.0:1788582244.847474:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff8d0c813a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1875464020924544:0@lo:400:kworker.0 00000001:00080000:3.0:1788582244.988899:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:3.0:1788582244.988913:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:3.0:1788582244.988924:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:3.0:1788582244.988934:0:7648:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000100:00100000:1.0:1788582245.217191:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582245.217441:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582245.217483:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582245.217511:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582245.217533:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582245.217554:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:0.0:1788582245.217600:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002076928 00000100:00100000:0.0:1788582245.217612:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002076928 00000100:00100000:0.0:1788582245.217668:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002077184 00000100:00100000:0.0:1788582245.217671:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002077184 00000100:00100000:0.0:1788582245.217696:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002076800 00000100:00100000:0.0:1788582245.217699:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002076800 00000100:00100000:0.0:1788582245.217718:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 18 00000100:00100000:0.0:1788582245.217727:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7721f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:2351:x1875464002076928:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582245.217802:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7721f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+6:2351:x1875464002076928:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 75us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582245.217810:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 18 00000100:00100000:0.0:1788582245.217827:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 19 00000100:00100000:0.0:1788582245.217834:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7720a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+5:2351:x1875464002077184:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582245.217858:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7720a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+5:2351:x1875464002077184:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 25us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582245.217875:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 19 00000100:00100000:0.0:1788582245.217886:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 20 00000100:00100000:0.0:1788582245.217891:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+5:2352:x1875464002076800:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:0.0:1788582245.217912:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7723800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3db2c11a-8b82-4246-9cf9-9575f62f5233+5:2352:x1875464002076800:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 20us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788582245.217933:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 20 00000100:00080000:0.0:1788582245.217953:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788582245.218222:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002076544 00000100:00100000:2.0:1788582245.218227:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002076544 00000100:00100000:2.0:1788582245.218267:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 122 00000100:00100000:2.0:1788582245.218274:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0dc2070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+13:2352:x1875464002076544:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:2.0:1788582245.218309:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0dc2070c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7c32afc4-6db4-4783-a556-081dabcc0c13+13:2352:x1875464002076544:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 36us (880us total) trans 0 rc 0/0 00000100:00100000:2.0:1788582245.218315:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 122 00000100:00100000:3.0:1788582245.225458:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002076672 00000100:00100000:3.0:1788582245.225472:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002076672 00000100:00100000:3.0:1788582245.225617:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 27 00000100:00100000:3.0:1788582245.225628:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+24:2351:x1875464002076672:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:3.0:1788582245.225789:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7720380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3db2c11a-8b82-4246-9cf9-9575f62f5233+24:2351:x1875464002076672:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 163us (8619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788582245.225798:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 27 00000100:00100000:1.0:1788582245.226026:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.12@tcp (source: 12345-192.168.201.12@tcp) 00000100:00100000:1.0:1788582245.226048:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002077056 00000100:00100000:1.0:1788582245.226051:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002077056 00000100:00080000:2.0:1788582245.228671:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788582245.228856:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 28 00000100:00100000:1.0:1788582245.228882:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+6:2352:x1875464002077056:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582245.228988:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7720000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+6:2352:x1875464002077056:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 110us (11433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582245.228997:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 28 00000100:00100000:1.0:1788582245.229028:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875464002077312 00000100:00100000:1.0:1788582245.229035:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875464002077312 00000100:00080000:2.0:1788582245.229316:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788582245.229440:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.12@tcp, seq: 21 00000100:00100000:1.0:1788582245.229449:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d0db7721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+5:2352:x1875464002077312:12345-192.168.201.12@tcp:400:kworker.0 00000100:00100000:1.0:1788582245.229481:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d0db7721500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:16af31e5-f4cf-4f02-9db7-6ba114cc9b47+5:2352:x1875464002077312:12345-192.168.201.12@tcp:400:kworker.0 Request processed in 34us (3457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788582245.229497:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.12@tcp, seq: 21 Debug log: 29332 lines, 29332 kept, 0 dropped, 0 bad.